-- Logs begin at Mon 2022-08-29 22:56:15 UTC, end at Tue 2022-08-30 00:13:01 UTC. -- Aug 29 23:42:04.829920 dv-cinder-854272-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 23:42:04.839046 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 23:42:04.840737 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 23:42:04 2022] *** Aug 29 23:42:04.840737 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 23:42:04.840737 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 23:42:04.840737 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: nodename: dv-cinder-854272-4-iscsi Aug 29 23:42:04.840737 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: machine: x86_64 Aug 29 23:42:04.840737 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: clock source: unix Aug 29 23:42:04.840737 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: pcre jit disabled Aug 29 23:42:04.840737 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: detected number of CPU cores: 4 Aug 29 23:42:04.840737 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: current working directory: / Aug 29 23:42:04.840737 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: detected binary path: /usr/bin/uwsgi-core Aug 29 23:42:04.841641 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: your processes number limit is 47680 Aug 29 23:42:04.841641 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: your memory page size is 4096 bytes Aug 29 23:42:04.841641 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: detected max file descriptor number: 2048 Aug 29 23:42:04.841641 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: lock engine: pthread robust mutexes Aug 29 23:42:04.841641 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: thunder lock: enabled Aug 29 23:42:04.841641 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 23:42:04.841641 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 23:42:04.880500 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: Python main interpreter initialized at 0x55c38baad9c0 Aug 29 23:42:04.880500 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: python threads support enabled Aug 29 23:42:04.880500 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: your server socket listen backlog is limited to 100 connections Aug 29 23:42:04.880500 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: your mercy for graceful operations on workers is 90 seconds Aug 29 23:42:04.880893 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 23:42:04.880969 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: *** Operational MODE: preforking *** Aug 29 23:42:04.881186 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: *** uWSGI is running in multiple interpreter mode *** Aug 29 23:42:04.881186 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: spawned uWSGI master process (pid: 112639) Aug 29 23:42:04.881404 dv-cinder-854272-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 23:42:04.882830 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: spawned uWSGI worker 1 (pid: 112640, cores: 1) Aug 29 23:42:04.882830 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: spawned uWSGI worker 2 (pid: 112641, cores: 1) Aug 29 23:42:04.882830 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 23:42:05.557095 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:42:05.594782 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:42:06.668551 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:42:06.668551 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: from cryptography.utils import int_from_bytes Aug 29 23:42:06.669272 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:42:06.669272 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: from cryptography.utils import int_from_bytes Aug 29 23:42:06.731763 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:42:06.731763 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: from cryptography.utils import int_from_bytes Aug 29 23:42:06.732331 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:42:06.732331 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: from cryptography.utils import int_from_bytes Aug 29 23:42:09.243165 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:42:09.243873 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:42:09.243997 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:42:09.244133 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:42:09.244490 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:42:09.244575 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:42:09.244657 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:42:09.244765 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:42:09.245034 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.245135 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:42:09.245359 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:42:09.245448 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.245711 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.245804 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.246034 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.246147 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.246355 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.246479 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.246697 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.246786 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.247022 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.247384 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.247530 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.247733 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.248003 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.248090 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.248317 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.248411 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.248638 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.248729 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.248897 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.248985 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854272-4-iscsi {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.249212 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.249307 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.249534 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854272-4-iscsi {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.249629 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.249854 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.249977 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.250161 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.250259 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.250492 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.250589 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.250811 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.250921 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.251111 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.251263 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.251429 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.251731 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.251822 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.252233 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.252327 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.252542 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.252664 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.252841 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.253001 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.253148 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.253268 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.253481 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.253572 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.253793 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.253925 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.254097 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.254201 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.254415 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.254525 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.254753 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.254890 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.255061 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.255157 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.255366 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.255460 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854272-4-iscsi {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.255757 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854272-4-iscsi {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.255850 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.256066 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.256163 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.256374 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.256460 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.256682 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.256810 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.257086 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.257185 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.257389 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.257474 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.257695 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.257788 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.258008 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.258101 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.258330 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.258414 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.258660 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.258748 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.258986 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.259094 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.259299 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.259396 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.259702 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.259914 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.260051 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.260212 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.260310 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.260516 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.260609 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.260819 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.260903 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.261122 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.261218 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.261420 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.261511 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.261669 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.261762 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.261950 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.262115 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.262251 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.262337 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.262594 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.262726 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.262958 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.263062 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.263211 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.263463 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.263548 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.263784 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.263888 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.264053 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.264189 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.264382 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.264485 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.264698 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.264790 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.265004 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.265093 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.265308 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.265411 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.265613 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.265703 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.265918 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.266008 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.266220 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.266318 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.266549 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.266641 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.266854 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.266953 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.267158 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.267257 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.267471 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.267561 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.267781 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.267878 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.268096 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.268192 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.268400 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.268513 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.268717 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.268803 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.269106 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.269211 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.269351 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.269437 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.269655 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.269741 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.269991 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.270078 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.270308 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.270397 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.270642 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.270732 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.270958 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.271046 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.271272 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.271363 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.271573 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.271663 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.271874 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.271962 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.272178 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.272264 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.272492 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.272585 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.272740 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.272825 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.273042 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.273128 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.273337 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.273430 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.273632 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.273718 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.273930 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.274022 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.274238 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.274342 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.274566 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.274654 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.274867 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.274963 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.275167 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.275263 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.275463 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.275550 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.275765 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.275851 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.276096 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.276239 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.276370 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.276485 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.276672 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.276793 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.276977 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.277104 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.277280 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.277390 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.277579 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.277798 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.277941 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.278035 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.278160 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.278241 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.279103 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.279287 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.279388 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.279641 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.279735 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.279949 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.280091 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.280275 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.280400 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.280585 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.280727 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.280892 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.280979 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.281218 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.281313 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.281527 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.281613 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.281833 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.281918 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.282152 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.282246 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.282480 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.282572 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.282792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.282890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.283112 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.283207 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.283415 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.283501 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.283720 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.283814 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.284032 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.284125 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.284331 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.284429 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.284631 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.284716 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.284934 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.285028 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.285236 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.285321 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.285536 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.285628 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.285838 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.285937 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.286138 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.286222 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.286457 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.286548 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.286753 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.286839 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.287049 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.287140 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.287348 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.287435 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.287643 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.287730 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.287959 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.288054 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.288263 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.288354 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.288572 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.288664 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.288876 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.288969 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.289177 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.289360 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.289492 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:42:09.289579 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.289822 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.289908 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.290154 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.290250 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.290516 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.290601 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.290842 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.290928 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.291157 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.291258 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.291473 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.291560 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.291799 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.291884 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.292107 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.292194 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.292416 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.292500 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.292727 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.292811 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.293032 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.293117 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.293341 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.293427 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.293650 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.293738 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.294021 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.294824 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.294898 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.295188 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.295282 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.295607 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.295704 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.295936 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.296022 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.296258 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.296346 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.296582 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.296676 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.296896 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.296982 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.297216 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.297310 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.297546 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.297650 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.297869 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.297955 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.298182 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.298268 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.298534 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.298627 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.298853 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.298939 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.299168 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.299253 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.299480 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.299568 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.299798 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.299883 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.300108 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.300212 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.300417 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.300545 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.300724 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.300811 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.301037 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.301122 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.301361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.301448 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.301667 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.301752 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.301974 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.302072 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.302281 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.302367 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.302617 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.302705 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.302924 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.303023 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.303231 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.303325 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.303540 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.303627 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.303846 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.303942 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.304152 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.304247 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.304474 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.304566 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.304783 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.304878 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.305095 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.305179 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.305405 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.305489 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.305715 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.305809 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.306023 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.306109 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.306328 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.306414 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.306657 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.306744 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.306966 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.307051 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.307266 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.307352 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.307567 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.307654 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.307868 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.307962 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.308174 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.308269 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.308477 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.308564 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.308795 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.308881 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.309103 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.309196 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.309412 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.309505 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.309805 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.309916 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.310126 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.310366 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.310560 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.310716 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.310876 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.311032 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.311184 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.311346 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.311508 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.311654 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.311819 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.311967 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.312128 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.312277 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.312452 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.312584 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.312760 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.312907 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.313070 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.313236 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.313388 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.313510 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.313699 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.313832 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.314013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.314139 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.314326 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.314469 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.314665 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.314791 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.315001 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.315092 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.315288 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.315404 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.315600 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.315717 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.316189 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.316277 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.316520 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.316605 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.316827 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.316920 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.317150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.317237 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.317475 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.317560 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.317790 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.317889 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.318102 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.318196 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.318410 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.318581 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.318739 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.318869 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.319047 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.319159 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.319348 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.319459 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.319664 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.319793 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.319951 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.320063 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.320255 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.320374 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.320555 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.320679 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.320856 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.320967 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.321152 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.321270 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.321454 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.321570 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.321757 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.321869 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.322057 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.322170 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.322357 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.322502 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.322689 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.322804 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.322993 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.323105 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.323292 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.323413 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.323595 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.323710 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.323898 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.324001 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.324241 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.324349 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.324543 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.324629 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.324884 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.325015 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.325739 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.325844 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.326063 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.326237 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.326370 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.326710 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.326834 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.327027 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.327113 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.327345 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.327430 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.327655 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.327740 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.327963 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.328055 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.328273 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.328357 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.328581 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.328674 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.328899 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.328984 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.329206 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.329291 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.329511 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.329596 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.329818 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.329920 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.330138 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.330233 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.330465 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.330555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.330797 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.330891 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.331086 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.331189 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.331400 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.331486 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.331711 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.331795 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.332022 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.332117 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.332335 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.332428 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.332648 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.332740 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.332954 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.333048 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.333266 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.333353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.333572 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.333658 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.333880 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.333967 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.334186 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.334283 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.334516 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.334625 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.334832 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.334921 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.335141 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.335229 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.335444 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.335536 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.335754 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.335841 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.336071 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.336157 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.336399 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.336491 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.336710 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.336803 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.337014 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.337100 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.337326 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.337421 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.337632 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.337730 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.337941 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.338034 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.338255 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.338349 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.338582 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.338684 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.338893 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.338978 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.339196 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.339294 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.339502 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.339602 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.339808 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.339905 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.340108 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.340206 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.340408 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.340496 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.340714 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.340817 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.341588 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.341776 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.341896 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.342206 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.342289 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.342602 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.342703 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.342918 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.343003 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.343236 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.343329 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.343547 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.343747 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.343855 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.343958 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.344153 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.344267 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.344460 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.344665 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.344775 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.344877 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.345080 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.345192 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.345385 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.345510 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.345692 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.345804 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.345998 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.346108 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.346332 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.346476 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.346652 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.346777 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.346958 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.347076 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.347260 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.347378 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.347564 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.347683 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.347868 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.347981 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.348191 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.348302 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.348909 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.348993 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.348993 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.349147 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.349227 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.349304 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.349381 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.349466 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.349695 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.349811 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.350006 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.350101 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.350309 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.350396 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.350644 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.350733 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.350958 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.351044 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.351265 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.351351 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.351571 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.351703 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.351879 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.351966 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.352187 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.352279 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.352491 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.352578 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.352800 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.352887 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.353114 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.353209 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.353427 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.353698 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.353784 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.354026 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.354156 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.354325 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.354415 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.354663 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.354770 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.354977 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.355072 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.355328 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.355551 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.355653 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.355880 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.355971 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.356194 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.356292 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.356532 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.356700 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.357029 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.357114 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.357342 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.357536 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.357636 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.357870 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.357959 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.358201 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.358287 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.358541 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.358631 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.358851 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.358940 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.359158 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.359243 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.359461 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.359546 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.359764 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.359850 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.360070 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.360155 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.360373 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.360472 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.360675 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.360768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.360977 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.361071 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.361287 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.361381 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.361594 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.361686 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.361907 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.361995 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.362213 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.362308 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.362541 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.362640 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.362847 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.362931 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.363146 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.363239 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.363455 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.363549 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.363758 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.363846 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.364078 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.364167 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.364385 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.364471 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.364687 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.364792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.364990 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.365088 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.365290 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.365385 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.365639 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.365723 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.365941 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.366034 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.366242 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.366326 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.366573 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.366677 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.366886 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.366973 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.367195 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.367289 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.367499 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.367664 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.367816 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.367910 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.368117 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.368203 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.368417 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.368532 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.368716 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.368811 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.369017 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.369103 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.369317 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.369414 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.369617 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.369701 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.369920 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.370004 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.370227 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.370325 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.370552 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.370650 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.370859 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.370945 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.371154 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.371247 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.371459 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.371547 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.371758 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.371845 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.372093 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.372183 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.372514 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.372609 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.372841 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.373066 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.373167 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.373353 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.373440 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.373665 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.373759 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.373975 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.374070 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.374278 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.374450 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.374617 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.374715 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.374924 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.375026 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.375239 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.375342 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.375544 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.375631 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.375844 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.375938 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.376147 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.376233 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.376452 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.376537 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.376754 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.376848 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.377055 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.377149 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.377375 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.377459 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.377679 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.377764 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.377980 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.378066 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.378280 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.378378 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.378611 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.378709 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.378912 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.378997 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.379214 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.379309 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.379520 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.379612 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.379824 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.379915 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.380130 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.380223 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.380473 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.380566 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.380729 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.380813 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.381025 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.381120 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.381328 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.381415 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.381628 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.381713 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.381928 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.382013 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.382224 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.382310 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.382551 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.382642 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.382853 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.382949 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.383152 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.383238 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.383453 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.383538 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.383770 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.383865 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.384074 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.384168 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.384374 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.384507 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.384676 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.384765 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.384977 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.385064 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.385315 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.385427 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.385617 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.385709 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.385933 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.386019 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.386246 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.386342 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.386582 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.386670 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.386888 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.386972 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.387194 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.387295 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.387498 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.387583 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.388352 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.388454 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.388663 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.388926 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.389173 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.389263 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.389501 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.389595 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.389831 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.389930 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.390138 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.390224 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.390465 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.390555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.390776 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.390899 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.391086 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.391180 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.391393 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.391479 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.391705 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.391792 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.392020 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.392104 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.392333 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.392417 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.392631 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.392724 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.392936 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.393031 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.393244 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.393337 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.393576 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.393682 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.393851 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.393944 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.394265 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.394370 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.394484 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.394574 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.394810 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.394896 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.395119 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.395214 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.395426 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.395531 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.395732 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.395819 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.396036 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.396131 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.396338 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.396431 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.396643 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.396736 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.396945 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.397110 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.397265 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.397379 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.397570 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.397694 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.397868 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.398008 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.398172 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.398322 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.398493 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.398663 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.398802 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.398984 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.399103 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.399301 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.399530 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.399616 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.399838 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.400012 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.400150 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.400327 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.400450 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.400640 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.400756 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.400955 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.401064 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.401263 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.401378 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.401567 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.401687 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.401882 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.401968 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.402209 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.402380 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.402540 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.402723 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.402847 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.403030 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.403155 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.403924 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.404031 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.404433 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.404526 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.404761 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.404846 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.405143 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.405236 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.405472 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.405584 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.405780 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.405876 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.406086 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.406195 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.406389 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.406533 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.406735 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.406847 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.407039 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.407172 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.407359 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.407495 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.407822 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.407907 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.408131 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.408217 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.408435 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.408547 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.408745 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.408833 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.409068 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.409161 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.409393 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.409480 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.409704 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.409789 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.410021 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.410156 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.410328 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.410441 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.410669 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.410755 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.410985 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.411083 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.411294 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.411380 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.411613 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.411698 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.411930 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.412022 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.412237 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.412324 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.412548 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.412634 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.412887 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.412991 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.413207 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.413303 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.413525 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.413613 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.413837 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.413940 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.414145 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.414229 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.414470 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.414560 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.414779 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.414906 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.415104 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.415197 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.415410 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.415503 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.415724 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.415830 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.416034 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.416119 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.416342 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.416436 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.416647 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.416742 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.416945 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.417037 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.417245 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.417340 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.417555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.417641 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.417852 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.417938 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.418158 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.418253 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.418485 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.418574 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.418793 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.418879 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.419148 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.419260 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.419468 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.419752 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.419840 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.420071 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.420157 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.420376 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.420463 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.420682 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.420768 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.420994 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.421086 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.421315 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.421403 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.421635 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.421720 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.421967 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.422061 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.422286 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.422372 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.422621 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.422711 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.422923 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.423018 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.423225 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.423311 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.423527 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.423614 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.423865 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.423964 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.424170 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.424263 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.424486 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.424572 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.424788 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.424881 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.425100 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.425186 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.425406 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.425499 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.425731 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.425873 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.426019 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.426106 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.426329 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.426435 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.426772 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.427105 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.427229 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.427318 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.427398 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.427475 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.427552 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.427619 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.427860 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.427947 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.428160 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.428258 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.428465 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.428552 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.428768 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.428853 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.429073 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.429166 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.429372 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.429457 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.429674 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.429760 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.429978 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.430074 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.430299 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.430386 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.430629 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.430718 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.430951 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.431061 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.431258 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.431346 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.431562 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.431651 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.431866 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.431953 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.432169 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.432255 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.432485 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.432570 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.432799 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.432892 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.433112 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.433204 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.433417 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.433502 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.433733 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.433818 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.434045 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.434133 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.434356 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.434459 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.434836 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.434967 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.435319 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.435419 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.435608 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.435809 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.435944 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.436136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.436222 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.436451 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.436544 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.436761 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.436850 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.437077 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.437164 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.437391 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.437484 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.437705 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.437794 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.438020 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.438249 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.438335 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.438604 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.438707 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.438919 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.439014 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.439231 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.439318 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.439542 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.439629 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.439855 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.439954 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.440165 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.440251 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.440472 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.440560 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.441033 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.441127 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.441396 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.441493 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.441707 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.441802 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.442033 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.442126 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.442350 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.442508 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.442690 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.442775 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.443006 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.443091 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.443321 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.443417 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.443633 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.443718 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.443944 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.444028 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.444255 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.444343 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.444564 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.444649 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.444878 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.444963 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.445196 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.445327 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.445506 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.445594 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.445819 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.445914 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.446141 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.446241 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.446464 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.446559 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.446775 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.446878 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.447086 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.447173 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.447396 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.447610 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.447697 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.447933 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.448020 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.448271 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.448413 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.448587 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.448682 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.448916 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.449010 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.449237 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.449324 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.449559 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.449655 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.449889 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.449975 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.450734 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.450844 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.451215 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.451314 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.451584 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.451949 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.452043 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.452258 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.452350 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.452588 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.452692 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.452905 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.452994 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.453218 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.453314 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.453540 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.453627 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.453852 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.453937 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.454176 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.454393 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.454502 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.455049 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.455142 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.455375 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.455463 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.455681 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.455768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.455984 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.456071 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.456307 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.456396 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.456621 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.456709 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.456926 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.457013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.457243 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.457338 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.457546 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.457632 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.457864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.458073 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.458180 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.458487 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.458590 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.458808 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.458903 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.459127 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.459212 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.459440 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.459527 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.459746 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.459832 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.460048 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.460134 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.460354 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.460447 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.460657 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.460744 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.460959 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.461054 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.461273 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.461358 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.461579 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.461671 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.461882 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.461981 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.462185 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.462272 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.462515 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.462619 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.462821 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.462917 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.463122 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.463209 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.463426 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.463513 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.463728 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.463828 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.464035 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.464120 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.464338 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.464423 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.464637 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.464725 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.464936 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.465022 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.465242 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.465327 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.465540 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.465634 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.466473 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.466612 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.466991 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.467077 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.467383 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.467483 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.467749 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.467836 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.468067 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.468154 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.468377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.468464 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.468682 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.468777 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.468995 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.469158 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.469300 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.469388 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.469609 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.469836 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.469955 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.470177 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.470265 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.470546 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.470647 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.470875 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.470967 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.471187 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.471274 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.471497 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.471584 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.471817 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.471904 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.472126 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.472213 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.472432 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.472525 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.472757 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.472855 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.473073 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.473160 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.473386 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.473603 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.473690 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.473935 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.474029 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.474254 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.474343 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.474611 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.474714 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.474924 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.475017 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.475235 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.475322 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.475538 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.475672 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.475846 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.475943 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.476158 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.476244 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.476467 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.476561 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.476777 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.476871 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.477081 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.477166 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.477391 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.477485 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.477695 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.477780 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.478001 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.478132 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.478308 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.478409 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.478640 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.478736 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.478946 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.479033 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.479250 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.479344 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.479555 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.479642 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.479862 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.479958 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.480167 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.480262 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.480471 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.480557 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.480779 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.480867 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.481095 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.481181 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.481406 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.481690 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.482112 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.482209 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.482298 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.482387 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.482503 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.482708 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.482796 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.483018 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.483106 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.483326 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.483412 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.483633 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.483720 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.483940 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.484028 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.484255 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.484355 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.484583 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.484680 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.484895 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.484982 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.485200 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.485287 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.485571 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.485706 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.485898 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.485992 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.486206 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.486294 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.486536 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.486641 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.486844 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.486930 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.487156 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.487242 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.487471 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.487559 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.487780 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.487866 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.488083 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.488205 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.488389 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.488482 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.488695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.488780 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.489001 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.489087 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.489308 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.489396 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.489614 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.489699 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.489920 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.490006 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.490218 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.490313 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.490545 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.490633 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.490849 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.490979 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.491154 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.491240 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.491457 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.491551 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.491756 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.491859 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.492052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.492137 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.492354 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.492441 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.492654 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.492754 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.492955 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.493044 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.493300 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.493394 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.493551 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.493686 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.493849 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.493934 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.494142 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.494228 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.494519 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.494609 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.494830 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.494916 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.495132 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.495219 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.495433 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.495522 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.495732 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.495818 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.496035 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.496128 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.496333 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.496421 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.496633 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.496722 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.496939 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.497026 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.497335 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.497434 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.497651 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.497904 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.498004 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.498224 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.498315 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.498599 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.498696 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.498911 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.499000 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.499225 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.499313 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.499531 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.499616 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.499850 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.499938 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.500155 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.500250 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.500465 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.500551 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.500779 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.500874 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.501091 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.501186 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.501397 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.501484 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.501711 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.501806 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.502020 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.502113 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.502327 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.502415 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.502663 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.502761 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.502971 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.503059 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.503278 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.503369 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.503583 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.503670 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.503893 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.503978 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.504212 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.504305 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.504524 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.504619 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.504836 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.504922 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.505151 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.505238 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.505465 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.505550 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.505776 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.505902 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.506085 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.506180 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.506399 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.506543 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.506737 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.506822 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.507045 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.507148 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.507351 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.507491 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.507658 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.507752 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.507965 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.508061 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.508278 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.508399 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.508587 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.508673 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.508894 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.508989 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.509205 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.509293 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.509460 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:42:09.509544 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.509821 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.510141 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.510470 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.510795 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.511117 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.511459 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.511768 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.512104 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.512428 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.513267 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.513804 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.514188 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:42:09.514472 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:42:09.663832 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO dbcounter [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Registered counter for database nova_api Aug 29 23:42:09.671694 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO dbcounter [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Registered counter for database nova_api Aug 29 23:42:09.685370 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:42:09.692964 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writer thread running {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:42:09.694270 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG oslo_db.sqlalchemy.engines [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:42:09.701927 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writer thread running {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:42:09.748748 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.context [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2479a3ab-d4a9-4ea8-94e1-1b0f52aef533(cell1) {{(pid=112641) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:42:09.752497 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:42:09.752968 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:42:09.754549 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:42:09.755278 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:42:09.755726 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:42:09.757477 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.context [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2479a3ab-d4a9-4ea8-94e1-1b0f52aef533(cell1) {{(pid=112640) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:42:09.757724 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:42:09.759735 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO dbcounter [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Registered counter for database nova_cell0 Aug 29 23:42:09.761281 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG oslo_concurrency.lockutils [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:42:09.761751 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG oslo_concurrency.lockutils [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:42:09.764255 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG oslo_concurrency.lockutils [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:42:09.765012 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG oslo_concurrency.lockutils [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:42:09.765454 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG oslo_concurrency.lockutils [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:42:09.766110 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO dbcounter [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Registered counter for database nova_cell1 Aug 29 23:42:09.767457 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG oslo_concurrency.lockutils [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112640) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:42:09.769440 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO dbcounter [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Registered counter for database nova_cell0 Aug 29 23:42:09.773198 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:42:09.773608 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO dbcounter [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Registered counter for database nova_cell1 Aug 29 23:42:09.775083 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:42:09.780456 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writer thread running {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:42:09.780941 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG oslo_db.sqlalchemy.engines [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:42:09.782385 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG oslo_db.sqlalchemy.engines [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:42:09.786666 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writer thread running {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:42:09.788767 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writer thread running {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:42:09.790969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writer thread running {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:42:09.930757 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO dbcounter [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Registered counter for database nova_cell0 Aug 29 23:42:09.936228 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO dbcounter [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Registered counter for database nova_cell0 Aug 29 23:42:09.941224 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:42:09.944944 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG oslo_db.sqlalchemy.engines [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:42:09.945736 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writer thread running {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:42:09.949381 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writer thread running {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:42:10.379524 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: WARNING keystonemiddleware.auth_token [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:42:10.386799 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: WARNING keystonemiddleware.auth_token [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:42:10.412407 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: WARNING keystonemiddleware.auth_token [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:42:10.420567 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: WARNING keystonemiddleware.auth_token [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:42:10.728279 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: WARNING keystonemiddleware.auth_token [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:42:10.734188 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: WARNING keystonemiddleware.auth_token [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:42:10.739478 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c38baad9c0 pid: 112641 (default app) Aug 29 23:42:10.741514 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:42:10.742736 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Aug 29 23:42:10.743139 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Mon Aug 29 23:42:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:42:10.767920 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: WARNING keystonemiddleware.auth_token [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:42:10.773837 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: WARNING keystonemiddleware.auth_token [None req-e81aeaa0-3828-4779-837f-bd611347d165 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:42:10.779680 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c38baad9c0 pid: 112640 (default app) Aug 29 23:43:35.683979 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:43:35.684980 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 29 23:43:35.685387 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:43:35.698762 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writing DB stats nova_api:SELECT=3 {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:35.699992 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writing DB stats nova_cell0:SELECT=3 {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:35.701032 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writing DB stats nova_cell1:SELECT=3 {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:35.702272 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:36.916172 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-15e71bb7-ef54-4b1c-a33f-04cd360fae4d admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:43:36.953119 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-15e71bb7-ef54-4b1c-a33f-04cd360fae4d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.259565 Aug 29 23:43:36.953758 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Aug 29 23:43:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:43:40.140332 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:43:40.141927 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-9a5f8686-6b47-4bf4-a5b3-45ee26251d1d None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002250 Aug 29 23:43:40.142824 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:43:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:43:40.838765 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-c0cd2408-e315-463a-bbfc-90541bfaa44c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "vcpus": 1, "swap": 0}} {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:43:40.931780 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-c0cd2408-e315-463a-bbfc-90541bfaa44c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.778870 Aug 29 23:43:40.932360 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Aug 29 23:43:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:43:40.949597 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writing DB stats nova_api:SELECT=3 {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:40.950923 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writing DB stats nova_cell1:SELECT=3 {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:40.952588 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writing DB stats nova_cell0:SELECT=3 {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:40.953670 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:41.174622 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-b542dd00-82fc-4e7e-a915-d52ae2230734 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:43:41.318597 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-b542dd00-82fc-4e7e-a915-d52ae2230734 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.377164 Aug 29 23:43:41.319366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Aug 29 23:43:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:43:44.426869 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-c0cd2408-e315-463a-bbfc-90541bfaa44c admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:43:44.427727 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-c0cd2408-e315-463a-bbfc-90541bfaa44c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Aug 29 23:43:44.428129 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:43:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:43:45.387011 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-ab00ef3a-ff71-4d5d-b331-bfb50dcb1289 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "disk": 5, "id": "d1"}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:43:45.495867 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-ab00ef3a-ff71-4d5d-b331-bfb50dcb1289 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.059298 Aug 29 23:43:45.496783 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Aug 29 23:43:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:43:45.513163 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-3a8ecd3c-7b5a-4862-95b3-25476bf5a675 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:43:45.662351 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-3a8ecd3c-7b5a-4862-95b3-25476bf5a675 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.153026 Aug 29 23:43:45.663549 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Aug 29 23:43:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:43:48.339095 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-ab00ef3a-ff71-4d5d-b331-bfb50dcb1289 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:43:48.340039 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-ab00ef3a-ff71-4d5d-b331-bfb50dcb1289 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001778 Aug 29 23:43:48.340442 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:43:48.839745 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-65262132-4694-48cc-bce0-2a6ea49ad251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "d2"}} {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:43:48.913965 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-65262132-4694-48cc-bce0-2a6ea49ad251 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.566756 Aug 29 23:43:48.914568 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Aug 29 23:43:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:43:48.928103 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-c7a753e9-a730-4447-a2ab-96d6c8dbed81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:43:49.037329 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-c7a753e9-a730-4447-a2ab-96d6c8dbed81 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113155 Aug 29 23:43:49.038174 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Aug 29 23:43:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:43:51.458367 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-65262132-4694-48cc-bce0-2a6ea49ad251 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:43:51.459467 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-65262132-4694-48cc-bce0-2a6ea49ad251 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Aug 29 23:43:51.459862 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:43:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:43:51.912236 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-128358b8-ddfc-4b33-a32b-580d7cdfdd7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:43:52.194552 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-128358b8-ddfc-4b33-a32b-580d7cdfdd7b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712154 Aug 29 23:43:52.194552 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Aug 29 23:43:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:43:52.194947 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-63d9056a-4008-4b55-9d98-f583937f6009 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:43:52.354714 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-63d9056a-4008-4b55-9d98-f583937f6009 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.166132 Aug 29 23:43:52.358800 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Aug 29 23:43:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:43:54.791549 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-128358b8-ddfc-4b33-a32b-580d7cdfdd7b admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:43:54.792847 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-128358b8-ddfc-4b33-a32b-580d7cdfdd7b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 Aug 29 23:43:54.800190 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:43:54 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:43:55.258336 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-4bf28b94-750a-43e6-8218-59e4c922a93b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "vcpus": 4}} {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:43:55.358366 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-4bf28b94-750a-43e6-8218-59e4c922a93b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.557312 Aug 29 23:43:55.358952 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Aug 29 23:43:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:43:55.371694 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-8a87230e-56a1-4ab5-a254-4659365d5f50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:43:55.456472 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-8a87230e-56a1-4ab5-a254-4659365d5f50 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088178 Aug 29 23:43:55.457343 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Aug 29 23:43:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:43:58.197099 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-4bf28b94-750a-43e6-8218-59e4c922a93b admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:43:58.198579 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-4bf28b94-750a-43e6-8218-59e4c922a93b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Aug 29 23:43:58.199045 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:43:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:43:58.706961 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-afaf6432-41da-46ee-a480-29953c0ea972 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:43:58.732801 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-afaf6432-41da-46ee-a480-29953c0ea972 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.524341 Aug 29 23:43:58.733484 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Aug 29 23:43:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:44:01.394480 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-4bf28b94-750a-43e6-8218-59e4c922a93b admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:01.395640 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-4bf28b94-750a-43e6-8218-59e4c922a93b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001895 Aug 29 23:44:01.396041 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:44:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:01.853177 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-69d28b09-88c1-440a-b4e5-dc68d1483cc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:01.932660 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-69d28b09-88c1-440a-b4e5-dc68d1483cc5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.529639 Aug 29 23:44:01.934081 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Aug 29 23:44:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:44:01.945561 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-d0baa676-16d5-4824-8863-74b1f4e96d22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:02.016184 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-d0baa676-16d5-4824-8863-74b1f4e96d22 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074226 Aug 29 23:44:02.017102 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Aug 29 23:44:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:44:04.493173 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-69d28b09-88c1-440a-b4e5-dc68d1483cc5 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:04.494254 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-69d28b09-88c1-440a-b4e5-dc68d1483cc5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 29 23:44:04.494702 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:44:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:04.943701 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-13e22080-9e10-4f3a-92b7-b668c17a9e69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:05.040882 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-13e22080-9e10-4f3a-92b7-b668c17a9e69 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.539582 Aug 29 23:44:05.042662 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Aug 29 23:44:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:44:05.053933 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-c9b02419-ef5d-4737-820e-2fe63a864d00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:05.164328 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-c9b02419-ef5d-4737-820e-2fe63a864d00 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114177 Aug 29 23:44:05.164911 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Aug 29 23:44:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:44:07.672482 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-13e22080-9e10-4f3a-92b7-b668c17a9e69 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:07.673498 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-13e22080-9e10-4f3a-92b7-b668c17a9e69 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 29 23:44:07.674155 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:44:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:08.295132 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-de3325c5-c0fd-4b07-a6e1-14c2284644ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "swap": 0, "id": "3", "os-flavor-access:is_public": true}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:08.369800 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-de3325c5-c0fd-4b07-a6e1-14c2284644ea admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.686430 Aug 29 23:44:08.371107 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Aug 29 23:44:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:44:08.389664 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-3f9b4b4a-3060-4744-b6e9-35d4ad87d212 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:08.398652 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:08.496415 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-3f9b4b4a-3060-4744-b6e9-35d4ad87d212 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112683 Aug 29 23:44:08.497106 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Aug 29 23:44:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:44:10.946274 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-de3325c5-c0fd-4b07-a6e1-14c2284644ea admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:10.947977 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-de3325c5-c0fd-4b07-a6e1-14c2284644ea admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002501 Aug 29 23:44:10.948673 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:44:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:11.457948 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-d99421ba-3a9b-4611-9760-c1672a0fb41c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:11.601068 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-d99421ba-3a9b-4611-9760-c1672a0fb41c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.645547 Aug 29 23:44:11.601832 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Aug 29 23:44:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:44:11.614247 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-a522a1c7-dff0-47d0-b223-b39b12d7af80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:11.723824 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-a522a1c7-dff0-47d0-b223-b39b12d7af80 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113753 Aug 29 23:44:11.725028 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Aug 29 23:44:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:44:14.191730 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-d99421ba-3a9b-4611-9760-c1672a0fb41c admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:14.195188 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-d99421ba-3a9b-4611-9760-c1672a0fb41c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 29 23:44:14.195188 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:44:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:14.680867 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-a4cfa55e-dd9e-4873-89e8-465cccf8546d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:14.692740 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:14.807167 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-a4cfa55e-dd9e-4873-89e8-465cccf8546d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.607483 Aug 29 23:44:14.808142 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Aug 29 23:44:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:44:14.820335 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-6b799127-78dd-4a65-83b9-4a22c593b4b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:14.906962 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-6b799127-78dd-4a65-83b9-4a22c593b4b8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090167 Aug 29 23:44:14.907678 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Aug 29 23:44:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:44:33.609045 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-a4cfa55e-dd9e-4873-89e8-465cccf8546d admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:33.610051 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-a4cfa55e-dd9e-4873-89e8-465cccf8546d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 29 23:44:33.610479 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:44:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:33.622000 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:34.058888 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-aeda0be2-5d0a-46d6-8919-2a19ba162179 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:34.077680 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-aeda0be2-5d0a-46d6-8919-2a19ba162179 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.460096 Aug 29 23:44:34.078226 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Aug 29 23:44:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:44:35.183950 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-a4cfa55e-dd9e-4873-89e8-465cccf8546d admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:35.184982 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-a4cfa55e-dd9e-4873-89e8-465cccf8546d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 29 23:44:35.185421 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:44:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:35.747262 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-ce506df7-5c1f-4667-8ef1-ae1206c96d12 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:35.753083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.wsgi [None req-ce506df7-5c1f-4667-8ef1-ae1206c96d12 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-ce506df7-5c1f-4667-8ef1-ae1206c96d12 admin admin] Request method failure captured: Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Accept: application/json Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Accept-Encoding: gzip, deflate Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Connection: keep-alive Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Content-Length: 0 Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Host: 10.222.0.58 Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Openstack-Api-Version: compute 2.90 Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Openstack-System-Scope: None Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: User-Agent: python-novaclient Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Auth-Token: gAAAAABjDU9jig7kClxhxDdCPiYJf4l6C8Ft0rc_olIb0tOpiI-BzNbz7wHW9Tm3PoXotLr76q68hkauO24JarHnBZFJpMIuMDtbHvqfSpRvgMvAt-IGfwtyDjLFxG8OI2e0pqNp0Pu5v3dJoWv__eh1YdhpVeRg56wwA8AQv13lqB-0UNTDSgE Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Domain-Id: None Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Domain-Name: None Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Identity-Status: Confirmed Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Is-Admin-Project: True Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Domain-Id: default Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Domain-Name: Default Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Name: admin Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Role: member,admin,reader Aug 29 23:44:35.756409 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Roles: member,admin,reader Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_291cfd89a4d34a9da9d99e5ca0c9d4dd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Tenant: admin Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Tenant-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Tenant-Name: admin Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User: admin Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Domain-Id: default Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Domain-Name: Default Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Id: 557208629c7f4826b594ef28cabef8ea Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Name: admin Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: method: > Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: exception: Flavor 42 could not be found. Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: action_args: {'id': '42'} Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:44:35.757969 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:35.759083 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:35.760517 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-ce506df7-5c1f-4667-8ef1-ae1206c96d12 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:44:35.762001 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-ce506df7-5c1f-4667-8ef1-ae1206c96d12 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.424621 Aug 29 23:44:35.762001 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Aug 29 23:44:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:35.769227 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-e94ac5b9-8a1a-46c6-9bbe-ba074c1f735a admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:35.793900 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-e94ac5b9-8a1a-46c6-9bbe-ba074c1f735a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028588 Aug 29 23:44:35.794569 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Aug 29 23:44:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:44:35.808698 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-9beb0fe8-17cd-428d-afc8-e426ed20a988 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:35.834096 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-9beb0fe8-17cd-428d-afc8-e426ed20a988 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030008 Aug 29 23:44:35.834728 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Aug 29 23:44:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:44:35.847061 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-78c04112-5a7b-4d17-9353-36a6d7d74c4c admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:35.854275 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.wsgi [None req-78c04112-5a7b-4d17-9353-36a6d7d74c4c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-78c04112-5a7b-4d17-9353-36a6d7d74c4c admin admin] Request method failure captured: Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Accept: application/json Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Accept-Encoding: gzip, deflate Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Connection: keep-alive Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Content-Length: 0 Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Host: 10.222.0.58 Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Openstack-Api-Version: compute 2.90 Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Openstack-System-Scope: None Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: User-Agent: python-novaclient Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Auth-Token: gAAAAABjDU9jig7kClxhxDdCPiYJf4l6C8Ft0rc_olIb0tOpiI-BzNbz7wHW9Tm3PoXotLr76q68hkauO24JarHnBZFJpMIuMDtbHvqfSpRvgMvAt-IGfwtyDjLFxG8OI2e0pqNp0Pu5v3dJoWv__eh1YdhpVeRg56wwA8AQv13lqB-0UNTDSgE Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Domain-Id: None Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Domain-Name: None Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Identity-Status: Confirmed Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Is-Admin-Project: True Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Domain-Id: default Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Domain-Name: Default Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Name: admin Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Role: member,admin,reader Aug 29 23:44:35.857768 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Roles: member,admin,reader Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_291cfd89a4d34a9da9d99e5ca0c9d4dd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Tenant: admin Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Tenant-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Tenant-Name: admin Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User: admin Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Domain-Id: default Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Domain-Name: Default Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Id: 557208629c7f4826b594ef28cabef8ea Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Name: admin Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: method: > Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: exception: Flavor 42 could not be found. Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: action_args: {'id': '42'} Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:44:35.864013 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:35.865792 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:35.868150 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-78c04112-5a7b-4d17-9353-36a6d7d74c4c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:44:35.870504 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-78c04112-5a7b-4d17-9353-36a6d7d74c4c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018154 Aug 29 23:44:35.870504 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Aug 29 23:44:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:36.914135 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-9beb0fe8-17cd-428d-afc8-e426ed20a988 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:36.915171 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-9beb0fe8-17cd-428d-afc8-e426ed20a988 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 29 23:44:36.915610 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:44:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:37.539332 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-b8c77655-6937-423a-a4ec-645c1654c881 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:37.548771 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.wsgi [None req-b8c77655-6937-423a-a4ec-645c1654c881 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-b8c77655-6937-423a-a4ec-645c1654c881 admin admin] Request method failure captured: Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Accept: application/json Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Accept-Encoding: gzip, deflate Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Connection: keep-alive Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Content-Length: 0 Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Host: 10.222.0.58 Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Openstack-Api-Version: compute 2.90 Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Openstack-System-Scope: None Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: User-Agent: python-novaclient Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Auth-Token: gAAAAABjDU9k33gkHshf6aLjtwnjPNpIa-3hLJRrHm72w9rWbV56rNQ4xsOnyodZY9OLadjlDIPUVj_gDvJ9l4xSZelgJ6vmqBC98kvaujW8hp9gqI-wjGl-ggRk3kWo-Q5ZQduHd6lBSiy9sFJkMIm8MCG6gG9wm9TZGyeyC3Xj032IK0wm04Y Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Domain-Id: None Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Domain-Name: None Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Identity-Status: Confirmed Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Is-Admin-Project: True Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Domain-Id: default Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Domain-Name: Default Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Name: admin Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Role: member,admin,reader Aug 29 23:44:37.552353 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Roles: member,admin,reader Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_291cfd89a4d34a9da9d99e5ca0c9d4dd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Tenant: admin Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Tenant-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Tenant-Name: admin Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User: admin Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Domain-Id: default Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Domain-Name: Default Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Id: 557208629c7f4826b594ef28cabef8ea Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Name: admin Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: method: > Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: exception: Flavor 84 could not be found. Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: action_args: {'id': '84'} Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:44:37.554864 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:37.556366 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:37.558555 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-b8c77655-6937-423a-a4ec-645c1654c881 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:44:37.560487 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-b8c77655-6937-423a-a4ec-645c1654c881 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.497226 Aug 29 23:44:37.560487 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Aug 29 23:44:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 499 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 23:44:37.568819 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-b5b207b0-e86f-4fa8-b527-208c6613fdae admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:37.586275 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-b5b207b0-e86f-4fa8-b527-208c6613fdae admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021821 Aug 29 23:44:37.586992 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Aug 29 23:44:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:44:37.597133 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-6094782d-5922-4719-8497-bd169662c9b0 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:37.613925 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-6094782d-5922-4719-8497-bd169662c9b0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020337 Aug 29 23:44:37.614458 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Aug 29 23:44:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:44:37.624300 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-43f7be0f-7ab1-4cb5-b9db-03b8bf87b9bb admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:37.630845 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.wsgi [None req-43f7be0f-7ab1-4cb5-b9db-03b8bf87b9bb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-43f7be0f-7ab1-4cb5-b9db-03b8bf87b9bb admin admin] Request method failure captured: Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Accept: application/json Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Accept-Encoding: gzip, deflate Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Connection: keep-alive Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Content-Length: 0 Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Host: 10.222.0.58 Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Openstack-Api-Version: compute 2.90 Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Openstack-System-Scope: None Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: User-Agent: python-novaclient Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Auth-Token: gAAAAABjDU9k33gkHshf6aLjtwnjPNpIa-3hLJRrHm72w9rWbV56rNQ4xsOnyodZY9OLadjlDIPUVj_gDvJ9l4xSZelgJ6vmqBC98kvaujW8hp9gqI-wjGl-ggRk3kWo-Q5ZQduHd6lBSiy9sFJkMIm8MCG6gG9wm9TZGyeyC3Xj032IK0wm04Y Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Domain-Id: None Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Domain-Name: None Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Identity-Status: Confirmed Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Is-Admin-Project: True Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Domain-Id: default Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Domain-Name: Default Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Name: admin Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Role: member,admin,reader Aug 29 23:44:37.632421 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Roles: member,admin,reader Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_291cfd89a4d34a9da9d99e5ca0c9d4dd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Tenant: admin Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Tenant-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Tenant-Name: admin Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User: admin Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Domain-Id: default Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Domain-Name: Default Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Id: 557208629c7f4826b594ef28cabef8ea Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Name: admin Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: method: > Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: exception: Flavor 84 could not be found. Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: action_args: {'id': '84'} Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:44:37.634890 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:37.636511 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:37.638052 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-43f7be0f-7ab1-4cb5-b9db-03b8bf87b9bb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:44:37.639514 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-43f7be0f-7ab1-4cb5-b9db-03b8bf87b9bb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013528 Aug 29 23:44:37.639514 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Aug 29 23:44:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 23:44:38.710503 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-6094782d-5922-4719-8497-bd169662c9b0 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:38.711544 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-6094782d-5922-4719-8497-bd169662c9b0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 29 23:44:38.711996 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:44:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:44:39.386572 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-059df940-90fa-4353-b0e0-15701e876ceb admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:39.392848 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.wsgi [None req-059df940-90fa-4353-b0e0-15701e876ceb admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-059df940-90fa-4353-b0e0-15701e876ceb admin admin] Request method failure captured: Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Accept: application/json Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Accept-Encoding: gzip, deflate Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Connection: keep-alive Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Content-Length: 0 Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Host: 10.222.0.58 Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Openstack-Api-Version: compute 2.90 Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Openstack-System-Scope: None Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: User-Agent: python-novaclient Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Auth-Token: gAAAAABjDU9m-eT929niyQrPdtgII93OogBt6ho0PtYeTn_3hwyCFSBfgopBCHdnB4yywhY9XLjmF6yIfacsCQFFov0xxhm-aPUZfcPeIoa6lDWgKCr0PSdS6gd4psL4ZvsuWmxv_kd5LQVAguo54BfrsfMmh2stGye_FQFhcI61-09_pPOksFI Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Domain-Id: None Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Domain-Name: None Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Identity-Status: Confirmed Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Is-Admin-Project: True Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Domain-Id: default Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Domain-Name: Default Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Project-Name: admin Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Role: member,admin,reader Aug 29 23:44:39.395136 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Roles: member,admin,reader Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_291cfd89a4d34a9da9d99e5ca0c9d4dd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Tenant: admin Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Tenant-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-Tenant-Name: admin Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User: admin Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Domain-Id: default Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Domain-Name: Default Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Id: 557208629c7f4826b594ef28cabef8ea Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: X-User-Name: admin Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: method: > Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: exception: Flavor 451 could not be found. Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: action_args: {'id': '451'} Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:44:39.397377 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:39.399009 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: ERROR nova.api.openstack.wsgi Aug 29 23:44:39.401422 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-059df940-90fa-4353-b0e0-15701e876ceb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112640) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:44:39.403735 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-059df940-90fa-4353-b0e0-15701e876ceb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.536002 Aug 29 23:44:39.403735 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Aug 29 23:44:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 537 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:39.410211 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-40cd76e1-e49b-49e2-89dc-ae6c8cf040f8 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:39.426332 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-40cd76e1-e49b-49e2-89dc-ae6c8cf040f8 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020616 Aug 29 23:44:39.426950 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Aug 29 23:44:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:44:39.445242 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:39.477348 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.039828 Aug 29 23:44:39.478297 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Aug 29 23:44:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:44:39.492598 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-e38017bc-91d1-48a6-b3d2-343ce1aeb675 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:39.498198 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.wsgi [None req-e38017bc-91d1-48a6-b3d2-343ce1aeb675 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-e38017bc-91d1-48a6-b3d2-343ce1aeb675 admin admin] Request method failure captured: Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Accept: application/json Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Accept-Encoding: gzip, deflate Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Connection: keep-alive Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Content-Length: 0 Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Host: 10.222.0.58 Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Openstack-Api-Version: compute 2.90 Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Openstack-System-Scope: None Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: User-Agent: python-novaclient Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Auth-Token: gAAAAABjDU9m-eT929niyQrPdtgII93OogBt6ho0PtYeTn_3hwyCFSBfgopBCHdnB4yywhY9XLjmF6yIfacsCQFFov0xxhm-aPUZfcPeIoa6lDWgKCr0PSdS6gd4psL4ZvsuWmxv_kd5LQVAguo54BfrsfMmh2stGye_FQFhcI61-09_pPOksFI Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Domain-Id: None Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Domain-Name: None Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Identity-Status: Confirmed Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Is-Admin-Project: True Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Domain-Id: default Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Domain-Name: Default Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Project-Name: admin Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Role: member,admin,reader Aug 29 23:44:39.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Roles: member,admin,reader Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/291cfd89a4d34a9da9d99e5ca0c9d4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_291cfd89a4d34a9da9d99e5ca0c9d4dd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Tenant: admin Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Tenant-Id: 291cfd89a4d34a9da9d99e5ca0c9d4dd Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-Tenant-Name: admin Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User: admin Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Domain-Id: default Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Domain-Name: Default Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Id: 557208629c7f4826b594ef28cabef8ea Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: X-User-Name: admin Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: method: > Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: exception: Flavor 451 could not be found. Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: action_args: {'id': '451'} Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:44:39.502284 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:39.504361 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: ERROR nova.api.openstack.wsgi Aug 29 23:44:39.506695 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-e38017bc-91d1-48a6-b3d2-343ce1aeb675 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:44:39.515288 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-e38017bc-91d1-48a6-b3d2-343ce1aeb675 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012288 Aug 29 23:44:39.515288 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Aug 29 23:44:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:40.555764 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:40.556958 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Aug 29 23:44:40.557419 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:44:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:44:41.154786 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-554965d1-49e5-4f06-91e4-3a31251b2ca9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:41.259905 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-554965d1-49e5-4f06-91e4-3a31251b2ca9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.560321 Aug 29 23:44:41.260392 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Aug 29 23:44:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:44:42.413374 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:42.414383 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 29 23:44:42.414815 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:44:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:43.015147 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-9a22b4de-cdb8-44ad-94f4-bd08c1c9b8da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:43.117345 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-9a22b4de-cdb8-44ad-94f4-bd08c1c9b8da admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.561185 Aug 29 23:44:43.118113 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Aug 29 23:44:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:44:44.141298 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:44.142312 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 29 23:44:44.142745 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:44:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:44.708592 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-d43c1399-2a13-44c9-9ca0-f5779b3764f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:44.782621 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-d43c1399-2a13-44c9-9ca0-f5779b3764f1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.498661 Aug 29 23:44:44.783140 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Aug 29 23:44:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:44:45.818802 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:45.820221 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001935 Aug 29 23:44:45.820729 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:44:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:44:46.411177 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-9017a893-b9ee-4729-8559-88f31ae25d8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:44:46.492387 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-9017a893-b9ee-4729-8559-88f31ae25d8c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.528344 Aug 29 23:44:46.492949 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Aug 29 23:44:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:44:47.572078 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:47.573143 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Aug 29 23:44:47.573616 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:44:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:44:48.162725 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-34997a92-96af-40e7-bdff-bf5a021f2099 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:44:48.184181 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-34997a92-96af-40e7-bdff-bf5a021f2099 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.467698 Aug 29 23:44:48.184751 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Mon Aug 29 23:44:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:45:45.340372 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:45.341302 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-e99ce2c4-9da9-4aaa-a7a4-c1b794769680 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 29 23:45:45.341700 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Mon Aug 29 23:45:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:45:45.353135 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:45.765221 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-f0b55b87-d658-4c29-9b5b-58c779c00c42 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:45.788482 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-f0b55b87-d658-4c29-9b5b-58c779c00c42 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.439729 Aug 29 23:45:45.789037 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Aug 29 23:45:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:45:45.810471 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG dbcounter [-] [112640] Writing DB stats nova_api:SELECT=14 {{(pid=112640) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:45.814261 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-cafbe167-9038-448d-a227-840a3b648157 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:45.822581 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-cafbe167-9038-448d-a227-840a3b648157 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013473 Aug 29 23:45:45.823120 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Mon Aug 29 23:45:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:45:45.839300 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-d12b81cf-0e52-4275-a3b4-f3bdee42b051 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:45.844410 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-d12b81cf-0e52-4275-a3b4-f3bdee42b051 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011660 Aug 29 23:45:45.844956 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Mon Aug 29 23:45:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:45:45.869006 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-f5a061c7-f965-4f44-8ba7-2864a7d846d5 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:45.869006 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-f5a061c7-f965-4f44-8ba7-2864a7d846d5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011674 Aug 29 23:45:45.869006 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Mon Aug 29 23:45:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:45:45.878482 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-8c214b0d-9601-4598-b15d-65b5255df998 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:45:45.894216 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-8c214b0d-9601-4598-b15d-65b5255df998 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011532 Aug 29 23:45:45.894216 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Mon Aug 29 23:45:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:49:01.704431 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-f5a061c7-f965-4f44-8ba7-2864a7d846d5 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:49:01.705431 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-f5a061c7-f965-4f44-8ba7-2864a7d846d5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 29 23:49:01.705821 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:49:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:49:01.848747 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writing DB stats nova_api:SELECT=6 {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:02.015459 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-9026e445-8f55-4add-a1be-a8df049f90c7 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:49:02.019230 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9026e445-8f55-4add-a1be-a8df049f90c7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:49:02.019708 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9026e445-8f55-4add-a1be-a8df049f90c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:49:02.020140 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9026e445-8f55-4add-a1be-a8df049f90c7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:49:02.020857 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9026e445-8f55-4add-a1be-a8df049f90c7 admin admin] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:49:02.021312 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9026e445-8f55-4add-a1be-a8df049f90c7 admin admin] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:49:02.021734 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-9026e445-8f55-4add-a1be-a8df049f90c7 admin admin] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:49:02.056527 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-9026e445-8f55-4add-a1be-a8df049f90c7 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.209149 Aug 29 23:49:02.057102 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Aug 29 23:49:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:49:02.896933 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-f5a061c7-f965-4f44-8ba7-2864a7d846d5 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:49:02.897931 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-f5a061c7-f965-4f44-8ba7-2864a7d846d5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 29 23:49:02.898317 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:49:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:49:03.096273 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-824bbe49-1331-4a48-971b-782ac942eab3 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:49:03.099711 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-824bbe49-1331-4a48-971b-782ac942eab3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:49:03.100176 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-824bbe49-1331-4a48-971b-782ac942eab3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:49:03.100597 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-824bbe49-1331-4a48-971b-782ac942eab3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:49:03.101298 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-824bbe49-1331-4a48-971b-782ac942eab3 admin admin] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:49:03.101765 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-824bbe49-1331-4a48-971b-782ac942eab3 admin admin] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:49:03.102174 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-824bbe49-1331-4a48-971b-782ac942eab3 admin admin] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:49:03.126046 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-824bbe49-1331-4a48-971b-782ac942eab3 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086605 Aug 29 23:49:03.126561 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Aug 29 23:49:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:49:14.366911 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-f5a061c7-f965-4f44-8ba7-2864a7d846d5 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:49:14.367916 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-f5a061c7-f965-4f44-8ba7-2864a7d846d5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 29 23:49:14.368305 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:49:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:49:14.513091 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writing DB stats nova_cell0:SELECT=4 {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:14.513839 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writing DB stats nova_cell1:SELECT=4 {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:14.514466 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG dbcounter [-] [112641] Writing DB stats nova_api:SELECT=8 {{(pid=112641) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:14.563619 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-26a55d91-1205-46fc-861e-93ce8aa532f4 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:49:14.567024 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-26a55d91-1205-46fc-861e-93ce8aa532f4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:49:14.567494 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-26a55d91-1205-46fc-861e-93ce8aa532f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:49:14.567919 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-26a55d91-1205-46fc-861e-93ce8aa532f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:49:14.568626 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-26a55d91-1205-46fc-861e-93ce8aa532f4 admin admin] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:49:14.569074 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-26a55d91-1205-46fc-861e-93ce8aa532f4 admin admin] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:49:14.569486 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-26a55d91-1205-46fc-861e-93ce8aa532f4 admin admin] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:49:14.596235 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-26a55d91-1205-46fc-861e-93ce8aa532f4 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087966 Aug 29 23:49:14.596799 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Aug 29 23:49:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:49:15.434712 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: DEBUG nova.api.openstack.wsgi [None req-f5a061c7-f965-4f44-8ba7-2864a7d846d5 admin admin] Calling method '>' {{(pid=112640) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:49:15.435749 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: INFO nova.api.openstack.requestlog [None req-f5a061c7-f965-4f44-8ba7-2864a7d846d5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Aug 29 23:49:15.436141 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: [pid: 112640|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Aug 29 23:49:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:49:15.629657 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG nova.api.openstack.wsgi [None req-a92d4af5-3578-402d-8929-7d9e263a1955 admin admin] Calling method '>' {{(pid=112641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:49:15.633149 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-a92d4af5-3578-402d-8929-7d9e263a1955 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:49:15.633625 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-a92d4af5-3578-402d-8929-7d9e263a1955 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:49:15.634055 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-a92d4af5-3578-402d-8929-7d9e263a1955 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:49:15.634810 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-a92d4af5-3578-402d-8929-7d9e263a1955 admin admin] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:49:15.635261 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-a92d4af5-3578-402d-8929-7d9e263a1955 admin admin] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:49:15.635680 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: DEBUG oslo_concurrency.lockutils [None req-a92d4af5-3578-402d-8929-7d9e263a1955 admin admin] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:49:15.657219 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: INFO nova.api.openstack.requestlog [None req-a92d4af5-3578-402d-8929-7d9e263a1955 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081952 Aug 29 23:49:15.657776 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: [pid: 112641|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Aug 29 23:49:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:50:15.921888 dv-cinder-854272-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 23:50:15.922936 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: Mon Aug 29 23:50:15 2022 - graceful shutdown triggered... Aug 29 23:50:15.923928 dv-cinder-854272-4-iscsi devstack@n-api.service[112641]: Gracefully killing worker 2 (pid: 112641)... Aug 29 23:50:15.924303 dv-cinder-854272-4-iscsi devstack@n-api.service[112640]: Gracefully killing worker 1 (pid: 112640)... Aug 29 23:50:16.924100 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: worker 1 buried after 1 seconds Aug 29 23:50:16.924663 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: worker 2 buried after 1 seconds Aug 29 23:50:16.924663 dv-cinder-854272-4-iscsi devstack@n-api.service[112639]: goodbye to uWSGI. Aug 29 23:50:16.925700 dv-cinder-854272-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 23:50:16.926307 dv-cinder-854272-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 23:50:16.929170 dv-cinder-854272-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 23:50:16.938319 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 23:50:16 2022] *** Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: nodename: dv-cinder-854272-4-iscsi Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: machine: x86_64 Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: clock source: unix Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: pcre jit disabled Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: detected number of CPU cores: 4 Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: current working directory: / Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: detected binary path: /usr/bin/uwsgi-core Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: your processes number limit is 47680 Aug 29 23:50:16.941281 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: your memory page size is 4096 bytes Aug 29 23:50:16.942045 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: detected max file descriptor number: 2048 Aug 29 23:50:16.942045 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: lock engine: pthread robust mutexes Aug 29 23:50:16.942045 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: thunder lock: enabled Aug 29 23:50:16.942045 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 23:50:16.942045 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 23:50:16.982341 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: Python main interpreter initialized at 0x55e58ee229c0 Aug 29 23:50:16.982341 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: python threads support enabled Aug 29 23:50:16.982341 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: your server socket listen backlog is limited to 100 connections Aug 29 23:50:16.982341 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: your mercy for graceful operations on workers is 90 seconds Aug 29 23:50:16.982814 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 23:50:16.982814 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: *** Operational MODE: preforking *** Aug 29 23:50:16.983086 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: *** uWSGI is running in multiple interpreter mode *** Aug 29 23:50:16.983086 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: spawned uWSGI master process (pid: 127684) Aug 29 23:50:16.983291 dv-cinder-854272-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 23:50:16.983922 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: spawned uWSGI worker 1 (pid: 127705, cores: 1) Aug 29 23:50:16.984199 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: spawned uWSGI worker 2 (pid: 127706, cores: 1) Aug 29 23:50:16.984355 dv-cinder-854272-4-iscsi devstack@n-api.service[127684]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 23:50:17.655954 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:50:17.665878 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 23:50:18.831792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:50:18.831792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: from cryptography.utils import int_from_bytes Aug 29 23:50:18.832407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:50:18.832407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: from cryptography.utils import int_from_bytes Aug 29 23:50:18.832407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:50:18.832407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: from cryptography.utils import int_from_bytes Aug 29 23:50:18.832946 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:50:18.832946 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: from cryptography.utils import int_from_bytes Aug 29 23:50:21.287636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:50:21.288189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:50:21.288512 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:50:21.288699 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:50:21.288964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:50:21.289367 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.289703 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.290029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.290357 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.290898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.291222 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.291610 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.291939 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.292279 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.292547 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.292869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.293199 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854272-4-iscsi {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.293526 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.293838 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.294157 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.294507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.294821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.295153 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.295480 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.295999 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.297361 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.297361 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.297361 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.297755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.298921 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.299159 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.299481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.299912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.300243 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.300559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.300816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:50:21.301262 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854272-4-iscsi {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.301348 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:50:21.301421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.301624 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.301748 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:50:21.301941 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.302046 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:50:21.302238 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:50:21.302502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.302736 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.302860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.303048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.303166 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.303374 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.303483 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.303705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.303832 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.304058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.304248 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.304428 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.304622 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.304745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.305011 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.305135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.305329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.305553 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.305670 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.305963 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.306188 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.306471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.306672 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.306807 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.306893 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.307169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.307369 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.307527 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.307676 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854272-4-iscsi {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.307828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.307977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.308190 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.308344 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.308485 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.308661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.308875 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.309039 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.309184 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.309373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.309536 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.309770 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.309937 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.310197 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.310364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.310616 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.310930 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.311087 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.311235 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.311535 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.311810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.312009 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.312160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.312299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.312450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.313189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.313369 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.313515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.313694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.313846 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.314064 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.314216 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.314376 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.314376 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.314694 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.314997 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.314997 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.315292 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.315292 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.315574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.315720 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.315870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.316019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.316179 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854272-4-iscsi {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.316328 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.316495 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.316651 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.316792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.316930 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.317068 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.317206 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.317206 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.317534 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.317689 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.317831 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.317975 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.318114 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.318489 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.318669 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.318826 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.318966 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.319402 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.319402 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.319695 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.319845 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.319992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.320140 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.320287 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.320653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.320815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.320815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.321749 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.322030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.322030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.322312 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.322505 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.322505 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.328847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.329141 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.329474 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.329678 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.329678 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.330002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.330168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.330313 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.330474 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.330474 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.330770 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.330926 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.330926 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.331226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.331378 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.331555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.331722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.331722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.332024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.332195 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.332346 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.332487 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.332487 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.332760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.332909 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.333051 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.333190 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.333948 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.334102 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.334256 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.334406 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.334651 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.334810 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.334953 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.335093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.335490 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.336484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.336775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.336931 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.337075 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.337216 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.337372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.337562 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.337723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.337878 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.338019 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.338675 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.338846 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.338989 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.339138 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.339278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.339425 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.339573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.339715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.339874 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.340026 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.340232 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.340382 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.340652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.340875 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.341039 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.341039 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.341321 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.341462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.341601 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.341749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.341903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.342064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.342205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.342344 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.342542 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.342702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.342855 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.343004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.343159 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.343300 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.343440 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.343587 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.343737 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.343896 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.344305 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.344457 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.344597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.344597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.345422 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.345581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.345729 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.345901 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.351208 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.351534 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.351705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.351862 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.352023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.352165 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.352307 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.352459 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.353163 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.353253 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.353346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.353431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.353529 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.353615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.353697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.353786 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.353877 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.353976 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.354060 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.354151 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.354243 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.354326 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.354407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.354526 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.354618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.354701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.354783 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.354872 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.354955 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.355051 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.355142 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.355232 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.355316 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.355406 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.355496 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.355587 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.355587 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.355758 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.355849 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.355932 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.356028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.356118 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.356217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.356632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.356775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.357013 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.357124 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.357210 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.357292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.357382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.357474 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.357558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.357648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.357739 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.357822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.357917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.358002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.358092 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.358092 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.358258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.358349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.358489 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.358746 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.358834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.358925 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.359018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.359102 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.359195 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.359278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.359368 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.359451 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.359534 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.359623 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.359707 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.359797 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.359889 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.359981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.360072 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.360072 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.360072 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.360072 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.360072 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.360533 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.360669 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.360755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.360863 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.361059 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.361209 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.361294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.361384 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.361477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.361575 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.361666 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.361750 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.361840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.361930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.362014 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.362105 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.362188 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.362269 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:50:21.362350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.362450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.362535 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.362634 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.362718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.362807 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.362897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.362987 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363082 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363165 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363244 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363404 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363494 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363592 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363772 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363855 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.363936 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364121 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364214 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364297 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364387 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364478 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364567 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364657 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364748 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364832 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.364922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365280 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365364 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365528 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365618 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365881 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.365965 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.366055 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.366146 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.366230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.366320 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.366410 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.366655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.366741 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.366827 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.366918 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367095 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367276 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367457 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367540 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367622 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367710 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367805 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367889 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.367980 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.368063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.368152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.368235 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.368401 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.368486 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.368575 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.368659 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.368908 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369098 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369265 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369354 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369445 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369543 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369725 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369816 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.369907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370007 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370099 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370265 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370353 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370353 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370559 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370656 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370741 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370823 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.370994 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.371085 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.371181 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.371265 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.371354 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.371520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.371607 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.371688 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.371767 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.371852 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.371934 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372066 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372266 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372358 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372505 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372605 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372687 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.372997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373134 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373206 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373289 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373369 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373649 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373814 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373887 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.373956 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374025 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374102 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374736 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.374896 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.375011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.375172 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.375321 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.375500 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.375656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.375825 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.375962 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.376829 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.376973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.377128 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.377218 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.377610 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.377718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.377941 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.378273 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.378626 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.379004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.379195 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.379310 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.379555 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.379667 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.379870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.379962 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.380183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.380282 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.380507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.380608 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.380822 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.380971 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.381150 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.381313 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.381456 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.381618 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.381764 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.382073 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.382393 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.382765 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.382865 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.383121 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.383213 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.383469 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.383549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.383811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.384018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.384133 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.384336 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.384577 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.384681 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.384902 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.385017 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.385220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.385345 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.385540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.385651 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.385853 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.385988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.386155 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.386298 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.386504 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.386617 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.386831 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.386976 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.387122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.387217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.387414 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.387528 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.387724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.387992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.388098 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.388323 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.388437 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.388627 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.388736 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.388952 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.389059 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.389230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.389395 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.389540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.389755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.389855 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.390071 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.390170 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.390436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.390545 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.390808 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.390909 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.391115 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.391212 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.391423 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.391523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.391793 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.392406 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.392703 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.393016 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.393125 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.393324 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.393422 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.393634 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.393731 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.393966 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.394066 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.394285 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.394377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.394622 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.394728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.394945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.395045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.395271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.395370 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.395591 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.395679 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.395913 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.396089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.396228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.396395 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.396559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.396729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.396897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.397030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.397192 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.397354 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.397507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.397704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.397802 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.398121 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.398227 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.398446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.398547 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.398768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.398878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.399094 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.399193 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.399408 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.399516 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.399722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.399830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.400035 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.400154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.400342 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.400441 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.400654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.400755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.400973 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.401063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.401328 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.401565 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.401664 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.401906 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.402005 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.402228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.402327 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.402577 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.402712 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.402905 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.403151 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.403250 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.403464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.403571 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.403787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.403898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.404120 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.404218 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.404455 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.404546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.404772 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.404870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.405088 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.405187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.405393 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.405491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.405710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.405810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.406019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.406141 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.406326 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.406484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.406670 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.406797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.406983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.407106 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.407288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.407459 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.407655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.407772 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.408018 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.408152 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.408271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.408423 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.408589 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.408734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.408898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.409057 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.409215 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.409396 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.409554 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.409718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.409889 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.409983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.410161 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.410308 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.410508 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.410648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.410801 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.411040 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.411138 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.411373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.411463 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.411701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.411809 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.412011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.412110 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.412320 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.412413 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.412649 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.412740 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.413009 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.413120 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.413316 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.413428 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.413643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.413743 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.413951 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.414095 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.414255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.414469 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.414599 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.414790 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.414913 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.415100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.415224 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.415425 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.415535 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.415748 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.415840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.416135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.416224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.416447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.416538 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.416756 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.416853 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.417061 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.417152 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.417373 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.417516 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.417677 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.417791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.417996 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.418113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.418307 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.418409 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.418637 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.418742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.418942 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.419033 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.419255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.419368 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.419567 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.419657 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.419876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.420053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.420186 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.420286 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.420493 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.420593 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.420811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.420916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.421116 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.421207 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.421421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.421520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.421726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.422006 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.422099 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.422333 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.422445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.422664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.422768 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.423074 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.423183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.423429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.423522 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.423805 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.423910 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.424123 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.424221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.424437 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.424537 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.424745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.424838 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.425051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.425150 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.425366 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.425465 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.425677 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.425776 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.425984 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.426075 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.426291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.426412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.426666 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.426766 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.426976 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.427066 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.427282 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.427374 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.427585 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.427673 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.427894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.427999 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.428201 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.428299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.428503 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.428606 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.428803 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.428903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.429140 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.429240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.429411 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.429505 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.429743 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.429851 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.430033 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.430134 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.430337 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.430457 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.430672 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.430781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.430976 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.431075 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.431280 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.431369 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.431586 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.431690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.431932 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.432032 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.432238 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.432337 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.432551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.432653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.432872 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.432963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.433192 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.433355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.433519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.433671 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.433792 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.433980 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.434079 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.434308 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.434412 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.434645 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.434739 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.434952 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.435045 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.435264 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.435399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.435580 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.435673 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.435892 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.435990 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.436213 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.436329 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.436525 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.436629 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.436832 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.436922 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.437147 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.437240 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.437462 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.437553 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.437767 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.437864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.438077 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.438220 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.441461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.441638 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.441761 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.441854 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.441950 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442136 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442405 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442704 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442795 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442886 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.442977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.443118 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.443209 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.443292 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.443381 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.443466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.443562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.443643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.443722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.443849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.443938 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444191 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444281 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444455 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444546 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444649 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444824 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444906 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.444988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.445083 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.445168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.445250 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.445471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.445572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.445783 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.445886 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.446089 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.446177 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.446394 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.446556 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.446731 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.446835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.447050 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.447149 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.447367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.447463 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.447670 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.447779 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.447983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.448095 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.448374 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.448472 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.448686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.448791 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.448996 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.449087 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.449299 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.449388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.449603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.449698 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.449910 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.450001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.450217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.450308 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.450554 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.450649 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.450861 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.450971 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.451168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.451266 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.451490 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.451589 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.451795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.451891 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.452117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.452215 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.452461 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.452558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.452813 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.452912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.453120 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.453225 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.453542 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.453633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.453856 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.453954 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.454169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.454894 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.455067 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.455227 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.455387 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.455525 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.455705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.455808 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.456023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.456114 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.456342 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.456557 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.456662 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.456881 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.456980 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.457201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.457300 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.457519 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.457619 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.457828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.457919 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.458137 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.458237 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.458487 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.458594 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.458808 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.458901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.459123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.459215 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.459445 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.459544 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.459771 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.459861 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.460100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.460199 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.460417 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.460516 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.460733 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.460831 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.461047 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.461146 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.461363 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.461454 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.461671 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.461760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.461983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.462082 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.462291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.462383 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.462624 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.462728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.462940 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.463029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.463244 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.463343 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.463560 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.463690 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.463872 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.464017 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.464189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.464276 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.464470 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.464562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.464773 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.464879 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.465117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.465254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.465407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.465489 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.465714 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.465828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.466032 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.466124 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.466340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.466462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.466680 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.466773 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.466986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.467085 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.467313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.467413 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.467623 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.467718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.467931 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.468030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.468236 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.468340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.468542 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.468671 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.468885 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.468986 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.469446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.469647 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.469754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.469847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.470108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.470294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.470590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.470729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.470832 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.471053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.471147 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.471369 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.471470 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.471690 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.471825 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.472005 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.472114 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.472317 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.472432 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.472629 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.472729 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.472970 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.473080 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.473278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.473383 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.473560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.473661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.473859 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.473959 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.474249 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.474350 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.474497 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.474600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.474809 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.474904 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.475117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.475286 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.475428 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.475603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.475754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.475912 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.476062 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.476333 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.476426 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.476649 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.476785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.476965 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.477072 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.477284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.477378 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.477575 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.477668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.477919 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.478026 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.478225 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.478317 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.478567 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.478663 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.478878 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.478974 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.479203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.479292 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.479518 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.479615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.479830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.479929 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.480144 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.480243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.480451 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.480585 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.480764 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.480862 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.481077 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.481176 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.481391 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.481491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.481701 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.481800 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.482016 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.482169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.482332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.482521 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.482674 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.482836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.483159 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.483268 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.483487 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.483591 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.483793 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.483884 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.484105 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.484246 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.484432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.484546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.484713 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.484806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.485027 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.485148 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.485719 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.485833 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.485913 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.485985 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.486058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.486365 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.486571 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.486654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.486745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.486842 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.487036 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.487142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.487363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.487461 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.487699 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.487799 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.488008 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.488112 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.488325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.488427 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.488638 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.488738 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.488951 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.489128 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.489272 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.489381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.489582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.489681 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.489902 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.490007 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.490297 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.490396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.490542 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.490626 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.490830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.490931 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.491136 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.491236 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.491450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.491548 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.491768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.491870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.492084 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.492176 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.492398 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.492491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.492709 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.492802 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.493025 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.493116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.493343 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.493444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.493668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.493773 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.493992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.494084 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.494309 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.494408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.494654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.494801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.494963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.495066 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.495272 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.495373 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.495585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.495789 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.495890 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.496103 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.496201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.496436 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.496536 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.496764 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.496856 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.497066 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.497169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.497371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.497471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.497678 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.497769 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.498025 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.498178 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.498310 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.498405 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.498646 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.498739 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.498960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.499181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.499284 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.499371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.499558 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.499652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.499864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.500070 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.500168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.500260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.500469 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.500572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.500788 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.500888 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.501644 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.501769 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.501966 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.502292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.502491 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.502627 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.502933 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.503045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.503381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.503496 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.503598 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.503691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.503907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.504007 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.504221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.504321 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.504531 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.504629 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.504871 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.504974 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.505154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.505260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.505462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.505628 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.505779 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.506012 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.506110 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.506347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.506531 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.512299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.512440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.512440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.512660 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.512763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.512849 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.512940 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513025 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513227 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513407 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513494 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513679 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513859 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.513943 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.514026 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.514117 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.514209 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.514303 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.514389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.514508 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.514603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.514697 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.514833 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.514939 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515070 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515163 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515247 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515338 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515432 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515525 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515611 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515787 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515787 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515951 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.515951 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.516152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.516245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.516330 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.516416 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.516501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.516585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.516675 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.517404 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.517541 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.517698 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.517860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.518028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.518175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.518295 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.518392 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.518510 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.518598 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.518679 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.518810 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.518904 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519256 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519348 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519444 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519706 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.519960 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.520043 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.520135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.520220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.520304 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.520458 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.520552 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.520653 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.520756 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.520841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.520973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521111 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521199 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521282 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521380 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521550 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521634 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521634 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521925 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.521925 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.522055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.522181 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.522287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.522520 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.522665 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.522836 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.522937 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.523149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.523250 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.523459 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.523551 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.523772 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.523865 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.524083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.524176 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.524395 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.524495 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.524705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.525023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.525212 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.525363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.525458 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.525684 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.525791 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.526007 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.526109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.526326 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.526447 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.526671 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.526773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.526983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.527087 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.527293 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.527386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.527603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.527707 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.527911 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.528002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.528227 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.528317 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.528539 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.528641 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.528848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.528947 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.529152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.529290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.529467 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.529566 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.529782 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.529875 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.530088 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.530180 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.530404 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.530573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.530748 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.530849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.531080 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.531172 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.531388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.531495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.531739 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.531831 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.532061 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.532152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.532408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.532567 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.532735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.532910 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.533085 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.533213 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.533300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.533395 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.533590 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.533693 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.533905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.533999 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.534212 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.534306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.534557 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.534655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.535377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.535484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.535573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.535669 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.535763 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.535849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.535849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.536003 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.536100 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.536186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.536407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.536506 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.536713 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.536822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.537021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.537122 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.537327 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.537430 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.537634 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.537779 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.537945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.538039 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.538250 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.538343 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.538581 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.538688 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.538888 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.539034 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.539194 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.539324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.539499 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.539804 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.539897 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.540114 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.540215 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.540424 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.540573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.540809 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.540937 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.541110 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.541208 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.541420 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.541530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.541722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.541825 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.542055 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.542153 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.542389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.542509 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.542732 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.542824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.543053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.543145 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.543363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.543467 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.543680 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.543778 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.543989 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.544081 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.544302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.544394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.544683 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.544791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.544947 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.545041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.545260 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.545355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.545592 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.545691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.545909 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.546001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.546222 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.546324 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.546558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.546654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.546871 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.546974 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.547182 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.547281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.547492 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.547592 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.547819 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.547923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.548677 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.548827 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.549000 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.549237 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.549355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.549454 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.549616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.549712 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.549931 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.550032 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.550242 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.550346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.550589 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.550695 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.550913 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.551017 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.551238 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.551373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.551553 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.551645 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.551866 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.551963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.552178 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.552390 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.552490 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.552713 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.552805 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.553039 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.553139 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.553366 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.553458 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.553683 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.553782 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.553998 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.554097 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.554324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.554442 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.554664 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.554758 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.554992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.555091 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.555308 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.555399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.555694 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.555799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.555983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.556077 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.556303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.556458 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.556641 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.556757 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.556935 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.557040 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.557282 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.557392 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.557586 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.557688 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.557891 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.557982 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.558135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:50:21.558228 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.558531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.558842 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.559149 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.559464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.559772 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.560078 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.560384 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.560689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.561004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.561310 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.561622 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.561927 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.562349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.562687 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.562996 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.563311 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.563666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.564563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.565026 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.565341 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.565654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.565984 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.566324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.566672 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.567002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.567319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.567675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.567995 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.568322 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.568647 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.568967 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.569282 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.569655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.569975 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.570290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.570630 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.570964 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.571260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.571585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.571908 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.572237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.572546 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.572873 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.573275 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.573600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.573921 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.574234 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.574591 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.574911 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.575224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.575540 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.575992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.576162 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.576482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.576859 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.577107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.577426 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.577745 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.578071 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.578397 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.578735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.579090 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.579419 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.580050 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.580401 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.580752 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.581086 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.581402 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.581724 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.582031 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:50:21.582276 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:50:21.622257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO dbcounter [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Registered counter for database nova_api Aug 29 23:50:21.643784 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:50:21.644814 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO dbcounter [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Registered counter for database nova_api Aug 29 23:50:21.650396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writer thread running {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:50:21.665135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_db.sqlalchemy.engines [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:50:21.671890 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writer thread running {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:50:21.707609 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.context [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2479a3ab-d4a9-4ea8-94e1-1b0f52aef533(cell1) {{(pid=127706) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:50:21.711659 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:21.712149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:21.713722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:21.714484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:21.714950 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:21.716935 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:21.718955 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO dbcounter [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Registered counter for database nova_cell0 Aug 29 23:50:21.724096 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO dbcounter [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Registered counter for database nova_cell1 Aug 29 23:50:21.731596 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:50:21.732061 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.context [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2479a3ab-d4a9-4ea8-94e1-1b0f52aef533(cell1) {{(pid=127705) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 23:50:21.733838 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:50:21.736864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:21.737437 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:21.739085 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:21.739831 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:50:21.740280 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:50:21.741791 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writer thread running {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:50:21.742323 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:50:21.743129 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writer thread running {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:50:21.744332 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO dbcounter [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Registered counter for database nova_cell0 Aug 29 23:50:21.748424 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO dbcounter [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Registered counter for database nova_cell1 Aug 29 23:50:21.756862 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_db.sqlalchemy.engines [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:50:21.759274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_db.sqlalchemy.engines [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:50:21.764891 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writer thread running {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:50:21.767159 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writer thread running {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:50:21.898661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO dbcounter [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Registered counter for database nova_cell0 Aug 29 23:50:21.905958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:50:21.911383 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writer thread running {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:50:21.918100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO dbcounter [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Registered counter for database nova_cell0 Aug 29 23:50:21.927342 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_db.sqlalchemy.engines [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:50:21.932923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writer thread running {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:50:22.242465 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: WARNING keystonemiddleware.auth_token [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:50:22.249797 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: WARNING keystonemiddleware.auth_token [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:50:22.257609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: WARNING keystonemiddleware.auth_token [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:50:22.265679 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: WARNING keystonemiddleware.auth_token [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:50:22.610218 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: WARNING keystonemiddleware.auth_token [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:50:22.618441 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: WARNING keystonemiddleware.auth_token [None req-7ad4ef0d-e1dc-4f76-a54c-5254ff811b67 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:50:22.624601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e58ee229c0 pid: 127706 (default app) Aug 29 23:50:22.629232 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: WARNING keystonemiddleware.auth_token [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 23:50:22.636613 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: WARNING keystonemiddleware.auth_token [None req-a442c046-4071-4239-af01-66cb5f488a14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 23:50:22.644195 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e58ee229c0 pid: 127705 (default app) Aug 29 23:51:01.067815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=3 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:01.068740 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=3 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:01.069518 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=3 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:01.071185 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=3 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:02.305263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d2df8aab-a4ef-48fe-b652-28e070e25ed6 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Action: 'create', calling method: .version_select at 0x7fabbee60e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-552955680", "metadata": {"Type": "work"}}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d2df8aab-a4ef-48fe-b652-28e070e25ed6 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Request method failure captured: Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 121 Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVDk25qWjdmjjGUYoQK2KWVKtSUCY6M9CIrU0A1fCW3YnCVC9_sduqOnKq5Cdr7CgAJJMG68tq2gTsnHJUFh2B7f6F8TSn3ZD8itbswsnlLBDHhxNpCAJQl4KZOERCdH9Z-j7_dU8w5LDxEFxy7DNbZvpHis7smJUACtKDs9-8ZFeOA Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:51:02.319550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f71b0d227a5147218377cab6f22a9b52", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 76ab113b2f3144da87bf572cc0b2344f Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-552955680", "metadata": {"Type": "work"}}} Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: Aug 29 23:51:02.321028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-552955680', 'metadata': {'Type': 'work'}}}} Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise error Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:51:02.321840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 23:51:02.323295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 23:51:02.586988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 23:51:02.586988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.586988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d2df8aab-a4ef-48fe-b652-28e070e25ed6 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:51:02.586988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d2df8aab-a4ef-48fe-b652-28e070e25ed6 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.269676 Aug 29 23:51:02.586988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Aug 29 23:51:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:51:02.590509 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:02.590509 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:02.590509 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:02.590509 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:02.679542 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-86b4d642-d6c1-4fb0-a7f6-55eccbaf5167 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Action: 'create', calling method: .version_select at 0x7fabbee56a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-748399897", "metadata": {"Type": "work"}}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-86b4d642-d6c1-4fb0-a7f6-55eccbaf5167 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Request method failure captured: Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 119 Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVDk25qWjdmjjGUYoQK2KWVKtSUCY6M9CIrU0A1fCW3YnCVC9_sduqOnKq5Cdr7CgAJJMG68tq2gTsnHJUFh2B7f6F8TSn3ZD8itbswsnlLBDHhxNpCAJQl4KZOERCdH9Z-j7_dU8w5LDxEFxy7DNbZvpHis7smJUACtKDs9-8ZFeOA Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:51:02.686609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f71b0d227a5147218377cab6f22a9b52", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 76ab113b2f3144da87bf572cc0b2344f Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-748399897", "metadata": {"Type": "work"}}} Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: Aug 29 23:51:02.695878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-748399897', 'metadata': {'Type': 'work'}}}} Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise error Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi '0' Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:51:02.696612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 23:51:02.697693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 23:51:02.698621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 23:51:02.698621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.698621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-86b4d642-d6c1-4fb0-a7f6-55eccbaf5167 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:51:02.698621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-86b4d642-d6c1-4fb0-a7f6-55eccbaf5167 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.352301 Aug 29 23:51:02.698621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 1/2] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Aug 29 23:51:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 357 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:51:02.703111 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c352cab8-8398-4ce9-be01-581d3a347b03 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Action: 'create', calling method: .version_select at 0x7fabbedad5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681599064", "metadata": {"Type": "work"}}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c352cab8-8398-4ce9-be01-581d3a347b03 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Request method failure captured: Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 118 Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVDk25qWjdmjjGUYoQK2KWVKtSUCY6M9CIrU0A1fCW3YnCVC9_sduqOnKq5Cdr7CgAJJMG68tq2gTsnHJUFh2B7f6F8TSn3ZD8itbswsnlLBDHhxNpCAJQl4KZOERCdH9Z-j7_dU8w5LDxEFxy7DNbZvpHis7smJUACtKDs9-8ZFeOA Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:51:02.711386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f71b0d227a5147218377cab6f22a9b52", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 76ab113b2f3144da87bf572cc0b2344f Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-681599064", "metadata": {"Type": "work"}}} Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: Aug 29 23:51:02.722476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-681599064', 'metadata': {'Type': 'work'}}}} Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise error Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi '' Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:51:02.724001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 23:51:02.725223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 23:51:02.726241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 23:51:02.726241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:02.726241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c352cab8-8398-4ce9-be01-581d3a347b03 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:51:02.727544 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c352cab8-8398-4ce9-be01-581d3a347b03 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018063 Aug 29 23:51:02.728645 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Aug 29 23:51:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:51:02.741007 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-99d4f4bd-2a13-4d90-837c-3be4dcd81c1e tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Calling method '.version_select at 0x7fabbf66d3a0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:03.162646 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-99d4f4bd-2a13-4d90-837c-3be4dcd81c1e tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] HTTP exception thrown: Volume tempest-invalid-2016762761 could not be found. Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-99d4f4bd-2a13-4d90-837c-3be4dcd81c1e tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Request method failure captured: Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2016762761 HTTP/1.1 Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVDk25qWjdmjjGUYoQK2KWVKtSUCY6M9CIrU0A1fCW3YnCVC9_sduqOnKq5Cdr7CgAJJMG68tq2gTsnHJUFh2B7f6F8TSn3ZD8itbswsnlLBDHhxNpCAJQl4KZOERCdH9Z-j7_dU8w5LDxEFxy7DNbZvpHis7smJUACtKDs9-8ZFeOA Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:51:03.166414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f71b0d227a5147218377cab6f22a9b52", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 76ab113b2f3144da87bf572cc0b2344f Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Volume tempest-invalid-2016762761 could not be found. Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'tempest-invalid-2016762761'} Aug 29 23:51:03.167828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2016762761 could not be found. (HTTP 404) (Request-ID: req-a617779a-ad0a-434f-a63f-6d0f9fbbcaea) Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:03.168582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:51:03.170497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2016762761 could not be found. Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:51:03.172658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2016762761 could not be found. Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2016762761 could not be found. Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-99d4f4bd-2a13-4d90-837c-3be4dcd81c1e tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Returning 404 to user: Volume tempest-invalid-2016762761 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-99d4f4bd-2a13-4d90-837c-3be4dcd81c1e tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2016762761" status: 404 len: 99 microversion: 2.1 time: 0.433863 Aug 29 23:51:03.175347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Aug 29 23:51:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2016762761 => generated 99 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 23:51:03.180311 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1326b1f1-8ae5-4a88-aa19-8ab10a3eb1d0 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005809 Aug 29 23:51:03.197217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d4af14c7-51ac-46fa-aeca-f1aafe77c2a3 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007638 Aug 29 23:51:03.197558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 3/5] 10.222.0.58 () {58 vars in 1140 bytes} [Mon Aug 29 23:51:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 23:51:03.203132 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1137 bytes} [Mon Aug 29 23:51:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 23:51:03.214600 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cd5a14b8-bc63-4cd3-9923-6bf24c52f94d tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Calling method '.version_select at 0x7fabbed2bca0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:03.427996 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-cd5a14b8-bc63-4cd3-9923-6bf24c52f94d tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] HTTP exception thrown: Volume 9575d965-4001-4121-aae7-123f4a6637e4 could not be found. Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cd5a14b8-bc63-4cd3-9923-6bf24c52f94d tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Request method failure captured: Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: DELETE /compute/v2.1/os-volumes/9575d965-4001-4121-aae7-123f4a6637e4 HTTP/1.1 Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVDk25qWjdmjjGUYoQK2KWVKtSUCY6M9CIrU0A1fCW3YnCVC9_sduqOnKq5Cdr7CgAJJMG68tq2gTsnHJUFh2B7f6F8TSn3ZD8itbswsnlLBDHhxNpCAJQl4KZOERCdH9Z-j7_dU8w5LDxEFxy7DNbZvpHis7smJUACtKDs9-8ZFeOA Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:51:03.431978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f71b0d227a5147218377cab6f22a9b52", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 76ab113b2f3144da87bf572cc0b2344f Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Volume 9575d965-4001-4121-aae7-123f4a6637e4 could not be found. Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '9575d965-4001-4121-aae7-123f4a6637e4'} Aug 29 23:51:03.433223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9575d965-4001-4121-aae7-123f4a6637e4 could not be found. (HTTP 404) (Request-ID: req-b2a617fe-f3e2-4cc1-af0e-de407b607dbc) Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:03.433964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:51:03.435164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9575d965-4001-4121-aae7-123f4a6637e4 could not be found. Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 23:51:03.436288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9575d965-4001-4121-aae7-123f4a6637e4 could not be found. Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9575d965-4001-4121-aae7-123f4a6637e4 could not be found. Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.437340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cd5a14b8-bc63-4cd3-9923-6bf24c52f94d tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Returning 404 to user: Volume 9575d965-4001-4121-aae7-123f4a6637e4 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:51:03.447620 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-cd5a14b8-bc63-4cd3-9923-6bf24c52f94d tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/9575d965-4001-4121-aae7-123f4a6637e4" status: 404 len: 109 microversion: 2.1 time: 0.226539 Aug 29 23:51:03.454781 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Aug 29 23:51:03 2022] DELETE /compute/v2.1/os-volumes/9575d965-4001-4121-aae7-123f4a6637e4 => generated 109 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:51:03.463460 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9ca2938e-5e78-45f5-bf31-e0d7e19f8305 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Calling method '.version_select at 0x7fabbec695e0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:03.509980 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-9ca2938e-5e78-45f5-bf31-e0d7e19f8305 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] HTTP exception thrown: Volume b50794a0-dde1-48d1-a01e-2ecc464d9ff3 could not be found. Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9ca2938e-5e78-45f5-bf31-e0d7e19f8305 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Request method failure captured: Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/os-volumes/b50794a0-dde1-48d1-a01e-2ecc464d9ff3 HTTP/1.1 Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVDk25qWjdmjjGUYoQK2KWVKtSUCY6M9CIrU0A1fCW3YnCVC9_sduqOnKq5Cdr7CgAJJMG68tq2gTsnHJUFh2B7f6F8TSn3ZD8itbswsnlLBDHhxNpCAJQl4KZOERCdH9Z-j7_dU8w5LDxEFxy7DNbZvpHis7smJUACtKDs9-8ZFeOA Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:51:03.512123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f71b0d227a5147218377cab6f22a9b52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f71b0d227a5147218377cab6f22a9b52", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: f71b0d227a5147218377cab6f22a9b52 Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-VolumesNegativeTest-341962897 Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 76ab113b2f3144da87bf572cc0b2344f Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-VolumesNegativeTest-341962897-project Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Volume b50794a0-dde1-48d1-a01e-2ecc464d9ff3 could not be found. Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'b50794a0-dde1-48d1-a01e-2ecc464d9ff3'} Aug 29 23:51:03.513127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b50794a0-dde1-48d1-a01e-2ecc464d9ff3 could not be found. (HTTP 404) (Request-ID: req-1bc6ede6-2e9f-43f3-8e94-be2540ba50c6) Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:03.513740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:51:03.514729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b50794a0-dde1-48d1-a01e-2ecc464d9ff3 could not be found. Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 23:51:03.515597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b50794a0-dde1-48d1-a01e-2ecc464d9ff3 could not be found. Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b50794a0-dde1-48d1-a01e-2ecc464d9ff3 could not be found. Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9ca2938e-5e78-45f5-bf31-e0d7e19f8305 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] Returning 404 to user: Volume b50794a0-dde1-48d1-a01e-2ecc464d9ff3 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9ca2938e-5e78-45f5-bf31-e0d7e19f8305 tempest-VolumesNegativeTest-341962897 tempest-VolumesNegativeTest-341962897-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b50794a0-dde1-48d1-a01e-2ecc464d9ff3" status: 404 len: 109 microversion: 2.1 time: 0.055832 Aug 29 23:51:03.517775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:51:03 2022] GET /compute/v2.1/os-volumes/b50794a0-dde1-48d1-a01e-2ecc464d9ff3 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:51:12.197423 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7c1b025b-f852-4ffe-a17b-89c41a0a111f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'create', calling method: .version_select at 0x7fabbec6c790>, body: {"keypair": {"name": "tempest-keypair-1273257739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlhHBFNcJVEunTEEf6Ut9HFTN18CXQwDX5QkzViXVqweTvZXCtz/W5WhXhniBiEcKPXxTRrGclnVySW5x79wEy2LNa/NaFRLSouq4zcNFT5ma6rvSPwwtOyu3HSqmrS1w=="}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:12.312916 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-7c1b025b-f852-4ffe-a17b-89c41a0a111f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Getting quotas for project 2d358f3073d446f49dc51777a7afc30e. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:51:12.330239 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-7c1b025b-f852-4ffe-a17b-89c41a0a111f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Getting quotas for user db604b7af623452fac9b3712b6978168 and project 2d358f3073d446f49dc51777a7afc30e. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:51:12.483460 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7c1b025b-f852-4ffe-a17b-89c41a0a111f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.861401 Aug 29 23:51:12.491570 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 5/9] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Aug 29 23:51:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:51:20.696252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-118464080", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:20.904477 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] validate_networks() for [('f41e94be-340b-4555-8a1d-79b9b3c4ac59', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:51:21.400861 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1849102061", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81309772-a7ea-411c-9807-d5770abcbfb5"}], "security_groups": [{"name": "tempest-securitygroup--586481541"}], "key_name": "tempest-keypair-1273257739", "user_data": "}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:22.365052 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=4 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:22.557429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] validate_networks() for [('81309772-a7ea-411c-9807-d5770abcbfb5', None, None, None, None, None)] {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:51:23.767238 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:51:23.768440 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:51:23.769233 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:51:23.769853 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:51:23.771084 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:51:23.827618 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:23.835147 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:23.835650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:23.838117 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:23.838627 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:23.845388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:23.990587 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Getting quotas for project cb38bc3ae5c14e4c8385809d84573600. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:51:24.022080 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Getting quotas for user 734d44438bfb4a79a68aa6705e49b1e9 and project cb38bc3ae5c14e4c8385809d84573600. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:51:24.074969 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:51:24.083375 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:51:24.333296 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-62537555-afd4-4353-847b-962bac5fd481 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.998373 Aug 29 23:51:24.334009 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 5/10] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:51:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 4000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:51:24.874935 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:51:24.875487 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:51:24.875857 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:51:24.876270 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:51:24.876687 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:51:24.891353 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:24.892535 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:24.893099 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:24.893985 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:24.894799 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:24.895504 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:24.939318 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-53112ad7-1cd2-4868-a29f-104aa2ea7485 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: .version_select at 0x7fabbeb7d820>, body: {"keypair": {"name": "tempest-keypair-663634174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0T4LnUVHCp8KvCcrbZ6OaWGl+Q3rdyaKPhbG1IiZVK/HrLDObi4FhcxXTWK9R3iaLucliA5YHexnJJ614LaGtSOX8xQknsAGEzQy5a1sIumVxDX+SrnftZEVgtNFyP+A=="}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:24.982752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Getting quotas for project 2d358f3073d446f49dc51777a7afc30e. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:51:24.998512 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Getting quotas for user db604b7af623452fac9b3712b6978168 and project 2d358f3073d446f49dc51777a7afc30e. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:51:25.023641 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-53112ad7-1cd2-4868-a29f-104aa2ea7485 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'key_pairs'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:51:25.041189 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-53112ad7-1cd2-4868-a29f-104aa2ea7485 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for user 34ef7ee27c3948ac9df1ff94ce24618e and project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'key_pairs'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:51:25.045766 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:51:25.053535 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:51:25.238085 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-53112ad7-1cd2-4868-a29f-104aa2ea7485 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.900407 Aug 29 23:51:25.240322 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 6/11] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Aug 29 23:51:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:51:25.306055 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0977578c-a596-4b4d-abd5-915159237cf5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.912206 Aug 29 23:51:25.307506 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 6/12] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:51:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 3914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 23:51:25.314021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0dd7ff87-defa-419d-9f37-03adfc4aeb5c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:25.315217 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0dd7ff87-defa-419d-9f37-03adfc4aeb5c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:25.581670 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0dd7ff87-defa-419d-9f37-03adfc4aeb5c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:25.642854 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0dd7ff87-defa-419d-9f37-03adfc4aeb5c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1221 microversion: 2.1 time: 0.327036 Aug 29 23:51:25.646309 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:25 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1221 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:25.678127 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-72fc1d79-2152-4993-b992-8487315ded28 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:25.687533 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-72fc1d79-2152-4993-b992-8487315ded28 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:25.856470 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-72fc1d79-2152-4993-b992-8487315ded28 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:25.866748 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-72fc1d79-2152-4993-b992-8487315ded28 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1238 microversion: 2.1 time: 0.204163 Aug 29 23:51:25.869281 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 8/14] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:25 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1238 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:25.947619 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1210021482", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "networks": [{"uuid": "e705eb9e-6339-4c6c-9900-25506cd0e1c1"}]}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:26.142142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] validate_networks() for [('e705eb9e-6339-4c6c-9900-25506cd0e1c1', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:51:26.598185 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-74e22e68-c033-4e81-8c1f-f725f2f18f06 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Action: 'create', calling method: .version_select at 0x7fabbeae35e0>, body: {"keypair": {"name": "tempest-keypair-349114742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU1T+mKvHQmfGvkCV1R4pOGlTBNrYlKt3yuBCMa6xHUbTVEoR6j9+lNDnSlflGh/E1I7MLIWlAx6s3hmRrDcSE46kgOEy202Ix+jabzr49g7W83EWzZv8G3WjjYud3VPw=="}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:26.640170 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-74e22e68-c033-4e81-8c1f-f725f2f18f06 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Getting quotas for project 3fd4107165644976b1d8cdbeec3c8711. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:51:26.653385 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-74e22e68-c033-4e81-8c1f-f725f2f18f06 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Getting quotas for user 90b2c6a74c29443b94d1577b39c7ce0b and project 3fd4107165644976b1d8cdbeec3c8711. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:51:26.789138 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-74e22e68-c033-4e81-8c1f-f725f2f18f06 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.909671 Aug 29 23:51:26.789138 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 9/15] 10.222.0.58 () {62 vars in 1200 bytes} [Mon Aug 29 23:51:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 916 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 23:51:26.821684 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-665507084", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:27.046367 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] validate_networks() for [('f41e94be-340b-4555-8a1d-79b9b3c4ac59', None, None, None, None, None)] {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:51:27.069063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:51:27.070005 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:51:27.070702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:51:27.071278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:51:27.071848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:51:27.092864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:27.095295 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:27.099579 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:27.101117 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:27.107552 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:27.109531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:27.217643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Getting quotas for project a8ada08f998844e997babd510083c205. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:51:27.242837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Getting quotas for user 2b88462a0d8d4e3fb4672a3f1d219c28 and project a8ada08f998844e997babd510083c205. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:51:27.320124 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:51:27.327878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:51:27.669617 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a54c8d9b-07d7-4213-ac95-637ca737a2ee tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.415529 Aug 29 23:51:27.670475 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 7/16] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:51:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:51:27.704352 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-85eee154-055e-4434-b3c9-df9e033b27e0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:27.706963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-85eee154-055e-4434-b3c9-df9e033b27e0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:28.443373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-85eee154-055e-4434-b3c9-df9e033b27e0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:28.514377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-85eee154-055e-4434-b3c9-df9e033b27e0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1238 microversion: 2.1 time: 0.834072 Aug 29 23:51:28.537751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 8/17] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:27 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1238 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:28.594034 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8684d9cd-e99d-4391-b203-3b9b4e136fde tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:28.601944 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8684d9cd-e99d-4391-b203-3b9b4e136fde tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:29.001240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8684d9cd-e99d-4391-b203-3b9b4e136fde tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:29.009277 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8684d9cd-e99d-4391-b203-3b9b4e136fde tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1215 microversion: 2.1 time: 0.468682 Aug 29 23:51:29.009757 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 9/18] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:28 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1215 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:29.235699 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:51:29.240974 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:51:29.242257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:51:29.244759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:51:29.246577 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:51:29.286992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:29.296042 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:29.298666 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:29.304591 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:29.306935 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:29.312514 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:29.366203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Getting quotas for project cb38bc3ae5c14e4c8385809d84573600. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:51:29.384818 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Getting quotas for user 734d44438bfb4a79a68aa6705e49b1e9 and project cb38bc3ae5c14e4c8385809d84573600. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:51:29.438754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:51:29.443543 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:51:29.540614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-88a22def-4938-47ba-bb20-06f17183fe70 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:29.541157 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-88a22def-4938-47ba-bb20-06f17183fe70 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:29.674527 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1852c73b-77f4-45bf-8cdc-8012b161ea39 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.884653 Aug 29 23:51:29.677521 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 10/19] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:51:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:51:29.695313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7f347476-b970-4282-b4e6-c902e96c56fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:29.696211 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7f347476-b970-4282-b4e6-c902e96c56fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:29.708385 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-88a22def-4938-47ba-bb20-06f17183fe70 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:29.727520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-88a22def-4938-47ba-bb20-06f17183fe70 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1238 microversion: 2.1 time: 0.190696 Aug 29 23:51:29.731118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 10/20] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:29 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1238 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:29.927330 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7f347476-b970-4282-b4e6-c902e96c56fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:29.939909 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7f347476-b970-4282-b4e6-c902e96c56fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1221 microversion: 2.1 time: 0.256797 Aug 29 23:51:29.959129 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 11/21] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:29 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1221 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:30.037717 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7c5a3168-cfb1-4d55-ad2c-9bef92da6ec2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:30.038542 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7c5a3168-cfb1-4d55-ad2c-9bef92da6ec2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:30.048749 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7c5a3168-cfb1-4d55-ad2c-9bef92da6ec2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:30.051233 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7c5a3168-cfb1-4d55-ad2c-9bef92da6ec2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:30.052609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7c5a3168-cfb1-4d55-ad2c-9bef92da6ec2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:30.053549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7c5a3168-cfb1-4d55-ad2c-9bef92da6ec2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:30.055979 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7c5a3168-cfb1-4d55-ad2c-9bef92da6ec2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:30.056618 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7c5a3168-cfb1-4d55-ad2c-9bef92da6ec2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:30.738556 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7c5a3168-cfb1-4d55-ad2c-9bef92da6ec2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:30.756617 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5ee2362e-232d-4d02-b199-aac5d28b1cef tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:30.758103 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5ee2362e-232d-4d02-b199-aac5d28b1cef tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:30.766405 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7c5a3168-cfb1-4d55-ad2c-9bef92da6ec2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1211 microversion: 2.1 time: 0.733847 Aug 29 23:51:30.770240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 11/22] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:30 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1211 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:30.790077 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ee2362e-232d-4d02-b199-aac5d28b1cef tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:30.802822 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ee2362e-232d-4d02-b199-aac5d28b1cef tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:30.803821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ee2362e-232d-4d02-b199-aac5d28b1cef tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:30.805112 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ee2362e-232d-4d02-b199-aac5d28b1cef tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:30.805991 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ee2362e-232d-4d02-b199-aac5d28b1cef tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:30.810062 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ee2362e-232d-4d02-b199-aac5d28b1cef tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:30.967514 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a506ba46-c25f-4cc7-b186-24fce89b9bee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:30.971314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a506ba46-c25f-4cc7-b186-24fce89b9bee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:31.516031 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5ee2362e-232d-4d02-b199-aac5d28b1cef tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:31.556140 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5ee2362e-232d-4d02-b199-aac5d28b1cef tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1242 microversion: 2.1 time: 0.805245 Aug 29 23:51:31.571869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 12/23] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:30 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1242 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:31.578145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a506ba46-c25f-4cc7-b186-24fce89b9bee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:31.597972 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a506ba46-c25f-4cc7-b186-24fce89b9bee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1221 microversion: 2.1 time: 0.633789 Aug 29 23:51:31.606830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 12/24] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:30 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1221 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:31.611972 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1209013860", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b596b2d-12e3-47f4-a595-eed3b3358a18"}], "security_groups": [{"name": "tempest-securitygroup--1359320678"}], "key_name": "tempest-keypair-663634174", "user_data": "}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:31.807481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-07903793-90e7-4667-a505-9622164aade7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:31.808115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-07903793-90e7-4667-a505-9622164aade7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:31.825995 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-07903793-90e7-4667-a505-9622164aade7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:31.826784 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-07903793-90e7-4667-a505-9622164aade7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:31.827397 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-07903793-90e7-4667-a505-9622164aade7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:31.828260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-07903793-90e7-4667-a505-9622164aade7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:31.830971 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-07903793-90e7-4667-a505-9622164aade7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:31.831848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-07903793-90e7-4667-a505-9622164aade7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:31.957039 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-07903793-90e7-4667-a505-9622164aade7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:31.968313 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-07903793-90e7-4667-a505-9622164aade7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1211 microversion: 2.1 time: 0.172290 Aug 29 23:51:31.982663 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 13/25] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:31 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1211 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:32.055055 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] validate_networks() for [('9b596b2d-12e3-47f4-a595-eed3b3358a18', None, None, None, None, None)] {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:51:32.582841 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-867131d3-89eb-4dcf-9264-0a2b2d8b9cff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:32.583690 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-867131d3-89eb-4dcf-9264-0a2b2d8b9cff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:32.590677 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867131d3-89eb-4dcf-9264-0a2b2d8b9cff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:32.591725 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867131d3-89eb-4dcf-9264-0a2b2d8b9cff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:32.594237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867131d3-89eb-4dcf-9264-0a2b2d8b9cff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:32.594237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867131d3-89eb-4dcf-9264-0a2b2d8b9cff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:32.594237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867131d3-89eb-4dcf-9264-0a2b2d8b9cff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:32.594237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867131d3-89eb-4dcf-9264-0a2b2d8b9cff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:32.838700 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-867131d3-89eb-4dcf-9264-0a2b2d8b9cff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:32.853024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-867131d3-89eb-4dcf-9264-0a2b2d8b9cff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1242 microversion: 2.1 time: 0.275968 Aug 29 23:51:32.866582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 14/26] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:32 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1242 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:32.873445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-aa746e4d-9619-4702-bbc6-0d68795294c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:32.875408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-aa746e4d-9619-4702-bbc6-0d68795294c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:32.904904 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa746e4d-9619-4702-bbc6-0d68795294c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:32.905770 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa746e4d-9619-4702-bbc6-0d68795294c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:32.911962 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa746e4d-9619-4702-bbc6-0d68795294c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:32.911962 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa746e4d-9619-4702-bbc6-0d68795294c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:32.911962 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa746e4d-9619-4702-bbc6-0d68795294c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:32.911962 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa746e4d-9619-4702-bbc6-0d68795294c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:33.017054 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:51:33.017540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:51:33.018635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:51:33.019957 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:51:33.021055 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:51:33.033213 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:33.034043 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:33.035386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:33.036531 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:33.037145 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:33.037716 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:33.096188 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:51:33.115652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for user 34ef7ee27c3948ac9df1ff94ce24618e and project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:51:33.123777 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-aa746e4d-9619-4702-bbc6-0d68795294c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:33.133142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-aa746e4d-9619-4702-bbc6-0d68795294c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1225 microversion: 2.1 time: 0.278285 Aug 29 23:51:33.133732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 15/27] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:32 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1225 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:33.141170 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1609814824", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39f95710-f788-408d-8a65-e81984f3a974"}], "security_groups": [{"name": "tempest-securitygroup--869025314"}], "key_name": "tempest-keypair-349114742", "user_data": "}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:33.157234 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:51:33.165861 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:51:33.400199 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4facbfe6-4890-4dea-adfb-ef0aa53aeacb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.805037 Aug 29 23:51:33.407741 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 13/28] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:51:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:51:33.413419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7bd345b6-4374-4313-984b-b912b1030969 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:33.415130 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7bd345b6-4374-4313-984b-b912b1030969 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:33.428920 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bd345b6-4374-4313-984b-b912b1030969 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:33.434772 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bd345b6-4374-4313-984b-b912b1030969 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:33.434772 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bd345b6-4374-4313-984b-b912b1030969 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:33.434772 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bd345b6-4374-4313-984b-b912b1030969 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:33.434772 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bd345b6-4374-4313-984b-b912b1030969 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:33.435263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bd345b6-4374-4313-984b-b912b1030969 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:33.608819 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7bd345b6-4374-4313-984b-b912b1030969 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:33.620207 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7bd345b6-4374-4313-984b-b912b1030969 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1267 microversion: 2.1 time: 0.211091 Aug 29 23:51:33.623480 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 14/29] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:33 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:33.629035 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-654f50b8-ba15-44ac-8bbd-ade84302d3ed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:33.636558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-654f50b8-ba15-44ac-8bbd-ade84302d3ed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:33.662966 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] validate_networks() for [('39f95710-f788-408d-8a65-e81984f3a974', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:51:33.831898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-654f50b8-ba15-44ac-8bbd-ade84302d3ed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:33.839535 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-654f50b8-ba15-44ac-8bbd-ade84302d3ed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1241 microversion: 2.1 time: 0.214696 Aug 29 23:51:33.840223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 15/30] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:33 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:33.882401 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3eb159a2-0b51-4dbe-9e91-985dd7030317 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:33.883064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3eb159a2-0b51-4dbe-9e91-985dd7030317 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:33.912533 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3eb159a2-0b51-4dbe-9e91-985dd7030317 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:33.917421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3eb159a2-0b51-4dbe-9e91-985dd7030317 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:33.917785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3eb159a2-0b51-4dbe-9e91-985dd7030317 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:33.918564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3eb159a2-0b51-4dbe-9e91-985dd7030317 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:33.919548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3eb159a2-0b51-4dbe-9e91-985dd7030317 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:33.923974 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3eb159a2-0b51-4dbe-9e91-985dd7030317 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:34.117664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3eb159a2-0b51-4dbe-9e91-985dd7030317 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:34.129694 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3eb159a2-0b51-4dbe-9e91-985dd7030317 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1234 microversion: 2.1 time: 0.252587 Aug 29 23:51:34.159304 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 16/31] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:33 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1234 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:34.181058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-844d2dfc-1280-4675-9393-546f35ba3fa1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:34.181712 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-844d2dfc-1280-4675-9393-546f35ba3fa1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:34.209274 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:34.219681 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-844d2dfc-1280-4675-9393-546f35ba3fa1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:34.222927 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-844d2dfc-1280-4675-9393-546f35ba3fa1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:34.226511 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-844d2dfc-1280-4675-9393-546f35ba3fa1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:34.227538 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-844d2dfc-1280-4675-9393-546f35ba3fa1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:34.229352 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-844d2dfc-1280-4675-9393-546f35ba3fa1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:34.229989 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-844d2dfc-1280-4675-9393-546f35ba3fa1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:34.720438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:51:34.721470 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:51:34.723061 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:51:34.723793 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:51:34.724983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:51:34.748288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-844d2dfc-1280-4675-9393-546f35ba3fa1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:34.759794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-844d2dfc-1280-4675-9393-546f35ba3fa1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1273 microversion: 2.1 time: 0.596445 Aug 29 23:51:34.760445 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 17/32] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:34 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1273 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:34.768807 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e74cbf35-7138-48c5-9e7d-84dd5ee63e2b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:34.769905 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e74cbf35-7138-48c5-9e7d-84dd5ee63e2b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:34.773793 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:34.774268 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:34.774757 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:34.776164 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:34.777029 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:34.777537 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:34.783428 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e74cbf35-7138-48c5-9e7d-84dd5ee63e2b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:34.783944 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e74cbf35-7138-48c5-9e7d-84dd5ee63e2b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:34.785197 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e74cbf35-7138-48c5-9e7d-84dd5ee63e2b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:34.785960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e74cbf35-7138-48c5-9e7d-84dd5ee63e2b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:34.788032 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e74cbf35-7138-48c5-9e7d-84dd5ee63e2b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:34.788500 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e74cbf35-7138-48c5-9e7d-84dd5ee63e2b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:34.831254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Getting quotas for project 3fd4107165644976b1d8cdbeec3c8711. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:51:34.845551 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Getting quotas for user 90b2c6a74c29443b94d1577b39c7ce0b and project 3fd4107165644976b1d8cdbeec3c8711. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:51:34.880694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:51:34.888650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:51:34.952980 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e74cbf35-7138-48c5-9e7d-84dd5ee63e2b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:34.963233 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e74cbf35-7138-48c5-9e7d-84dd5ee63e2b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1275 microversion: 2.1 time: 0.201601 Aug 29 23:51:34.963830 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 18/33] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:34 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:34.985722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b865d487-5a16-4a13-b541-028184bf8b53 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:34.986349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b865d487-5a16-4a13-b541-028184bf8b53 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:35.196292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7debfef1-a821-4e43-b9f3-b0015874ce3a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.060670 Aug 29 23:51:35.211223 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 16/34] 10.222.0.58 () {62 vars in 1188 bytes} [Mon Aug 29 23:51:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 23:51:35.263478 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9d361cfc-18ee-4724-b755-5ac0b8e987b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:35.270611 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9d361cfc-18ee-4724-b755-5ac0b8e987b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:35.330239 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b865d487-5a16-4a13-b541-028184bf8b53 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:35.338123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9d361cfc-18ee-4724-b755-5ac0b8e987b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:35.338861 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9d361cfc-18ee-4724-b755-5ac0b8e987b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:35.339331 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9d361cfc-18ee-4724-b755-5ac0b8e987b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:35.340055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9d361cfc-18ee-4724-b755-5ac0b8e987b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:35.340502 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9d361cfc-18ee-4724-b755-5ac0b8e987b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:35.345337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9d361cfc-18ee-4724-b755-5ac0b8e987b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:35.346634 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b865d487-5a16-4a13-b541-028184bf8b53 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1241 microversion: 2.1 time: 0.371760 Aug 29 23:51:35.355826 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 19/35] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:34 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1241 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:35.373742 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c5eb40e9-81e1-4ba6-9c9f-a6f701cba703 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:35.381085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c5eb40e9-81e1-4ba6-9c9f-a6f701cba703 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:35.555481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9d361cfc-18ee-4724-b755-5ac0b8e987b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:35.570812 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9d361cfc-18ee-4724-b755-5ac0b8e987b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1298 microversion: 2.1 time: 0.349770 Aug 29 23:51:35.571400 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 17/36] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:35 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1298 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:35.779804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0c5c0e97-966e-4f67-af33-9e425702b2fd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:35.780408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0c5c0e97-966e-4f67-af33-9e425702b2fd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:35.787451 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c5eb40e9-81e1-4ba6-9c9f-a6f701cba703 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:35.795939 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c5c0e97-966e-4f67-af33-9e425702b2fd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:35.796444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c5c0e97-966e-4f67-af33-9e425702b2fd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:35.796874 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c5c0e97-966e-4f67-af33-9e425702b2fd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:35.797592 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c5c0e97-966e-4f67-af33-9e425702b2fd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:35.798041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c5c0e97-966e-4f67-af33-9e425702b2fd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:35.798489 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c5c0e97-966e-4f67-af33-9e425702b2fd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:35.808267 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c5eb40e9-81e1-4ba6-9c9f-a6f701cba703 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:35.817435 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c5eb40e9-81e1-4ba6-9c9f-a6f701cba703 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:35.824187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c5eb40e9-81e1-4ba6-9c9f-a6f701cba703 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1281 microversion: 2.20 time: 0.464329 Aug 29 23:51:35.839157 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 20/37] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:35 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1281 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:35.989881 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1c5c672c-13c6-4435-ad22-be362c4037e6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:35.990659 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1c5c672c-13c6-4435-ad22-be362c4037e6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:36.000154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0c5c0e97-966e-4f67-af33-9e425702b2fd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:36.002174 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1c5c672c-13c6-4435-ad22-be362c4037e6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:36.003419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1c5c672c-13c6-4435-ad22-be362c4037e6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:36.005481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1c5c672c-13c6-4435-ad22-be362c4037e6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:36.018649 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0c5c0e97-966e-4f67-af33-9e425702b2fd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1273 microversion: 2.1 time: 0.240676 Aug 29 23:51:36.021556 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 18/38] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:35 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:36.026609 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1c5c672c-13c6-4435-ad22-be362c4037e6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:36.038607 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1c5c672c-13c6-4435-ad22-be362c4037e6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:36.038607 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1c5c672c-13c6-4435-ad22-be362c4037e6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:36.355114 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1c5c672c-13c6-4435-ad22-be362c4037e6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:36.367705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1c5c672c-13c6-4435-ad22-be362c4037e6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1285 microversion: 2.1 time: 0.383256 Aug 29 23:51:36.368888 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 21/39] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:35 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1285 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:36.390030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-eeeb5600-f5c4-40e8-b8b1-1e9a93c08894 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:36.391012 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-eeeb5600-f5c4-40e8-b8b1-1e9a93c08894 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:36.404253 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eeeb5600-f5c4-40e8-b8b1-1e9a93c08894 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:36.405537 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eeeb5600-f5c4-40e8-b8b1-1e9a93c08894 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:36.407472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eeeb5600-f5c4-40e8-b8b1-1e9a93c08894 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:36.410464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eeeb5600-f5c4-40e8-b8b1-1e9a93c08894 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:36.411229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eeeb5600-f5c4-40e8-b8b1-1e9a93c08894 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:36.418913 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eeeb5600-f5c4-40e8-b8b1-1e9a93c08894 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:36.593659 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3cc73e75-ffd4-4a3e-85cb-c4e71d79b763 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:36.594453 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3cc73e75-ffd4-4a3e-85cb-c4e71d79b763 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:36.602368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3cc73e75-ffd4-4a3e-85cb-c4e71d79b763 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:36.603156 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3cc73e75-ffd4-4a3e-85cb-c4e71d79b763 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:36.603759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3cc73e75-ffd4-4a3e-85cb-c4e71d79b763 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:36.604715 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3cc73e75-ffd4-4a3e-85cb-c4e71d79b763 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:36.605418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3cc73e75-ffd4-4a3e-85cb-c4e71d79b763 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:36.606030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3cc73e75-ffd4-4a3e-85cb-c4e71d79b763 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:36.629208 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-eeeb5600-f5c4-40e8-b8b1-1e9a93c08894 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:36.644444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-eeeb5600-f5c4-40e8-b8b1-1e9a93c08894 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1293 microversion: 2.1 time: 0.276047 Aug 29 23:51:36.646888 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 19/40] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:36 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:36.763651 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3cc73e75-ffd4-4a3e-85cb-c4e71d79b763 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:36.780321 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3cc73e75-ffd4-4a3e-85cb-c4e71d79b763 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1296 microversion: 2.1 time: 0.188510 Aug 29 23:51:36.784935 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 22/41] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:36 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1296 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:36.854510 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-53db11ed-9ec5-49c8-baa3-e80398520773 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:36.855135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-53db11ed-9ec5-49c8-baa3-e80398520773 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:37.029264 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-53db11ed-9ec5-49c8-baa3-e80398520773 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:37.045632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ccb0113e-2fe7-423a-91b9-1db75b9d7893 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:37.046558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ccb0113e-2fe7-423a-91b9-1db75b9d7893 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:37.061230 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-53db11ed-9ec5-49c8-baa3-e80398520773 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:37.068001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-53db11ed-9ec5-49c8-baa3-e80398520773 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:37.068263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ccb0113e-2fe7-423a-91b9-1db75b9d7893 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:37.069986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ccb0113e-2fe7-423a-91b9-1db75b9d7893 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:37.070643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ccb0113e-2fe7-423a-91b9-1db75b9d7893 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:37.073807 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ccb0113e-2fe7-423a-91b9-1db75b9d7893 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:37.073984 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-53db11ed-9ec5-49c8-baa3-e80398520773 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1281 microversion: 2.20 time: 0.225073 Aug 29 23:51:37.076600 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ccb0113e-2fe7-423a-91b9-1db75b9d7893 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:37.077074 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ccb0113e-2fe7-423a-91b9-1db75b9d7893 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:37.078004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 20/42] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:36 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:37.224755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ccb0113e-2fe7-423a-91b9-1db75b9d7893 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:37.255765 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ccb0113e-2fe7-423a-91b9-1db75b9d7893 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1279 microversion: 2.1 time: 0.215536 Aug 29 23:51:37.266165 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 23/43] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:37 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:37.392701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e991b1c4-6de8-4109-9814-b1f1d2537b10 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:37.393397 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e991b1c4-6de8-4109-9814-b1f1d2537b10 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:37.418837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e991b1c4-6de8-4109-9814-b1f1d2537b10 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:37.419414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e991b1c4-6de8-4109-9814-b1f1d2537b10 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:37.419891 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e991b1c4-6de8-4109-9814-b1f1d2537b10 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:37.420643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e991b1c4-6de8-4109-9814-b1f1d2537b10 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:37.431603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e991b1c4-6de8-4109-9814-b1f1d2537b10 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:37.432212 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e991b1c4-6de8-4109-9814-b1f1d2537b10 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:37.668552 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-15e815e6-6e8b-4487-ada3-ae16dea11d21 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:37.669257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-15e815e6-6e8b-4487-ada3-ae16dea11d21 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:37.679257 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e991b1c4-6de8-4109-9814-b1f1d2537b10 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:37.695003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e815e6-6e8b-4487-ada3-ae16dea11d21 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:37.696249 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e991b1c4-6de8-4109-9814-b1f1d2537b10 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1273 microversion: 2.1 time: 0.302955 Aug 29 23:51:37.696914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 21/44] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:37 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1273 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:37.719814 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e815e6-6e8b-4487-ada3-ae16dea11d21 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:37.720611 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e815e6-6e8b-4487-ada3-ae16dea11d21 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:37.722832 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e815e6-6e8b-4487-ada3-ae16dea11d21 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:37.725726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e815e6-6e8b-4487-ada3-ae16dea11d21 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:37.740342 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e815e6-6e8b-4487-ada3-ae16dea11d21 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:37.805119 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-49412468-a760-4b8d-92cb-bd581e60eef8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:37.806145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-49412468-a760-4b8d-92cb-bd581e60eef8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:37.811519 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:37.824002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49412468-a760-4b8d-92cb-bd581e60eef8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:37.824498 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49412468-a760-4b8d-92cb-bd581e60eef8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:37.824930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49412468-a760-4b8d-92cb-bd581e60eef8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:37.825642 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49412468-a760-4b8d-92cb-bd581e60eef8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:37.826292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49412468-a760-4b8d-92cb-bd581e60eef8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:37.826946 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49412468-a760-4b8d-92cb-bd581e60eef8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:38.255326 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-49412468-a760-4b8d-92cb-bd581e60eef8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:38.257948 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-15e815e6-6e8b-4487-ada3-ae16dea11d21 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:38.265755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-15e815e6-6e8b-4487-ada3-ae16dea11d21 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1293 microversion: 2.1 time: 0.601233 Aug 29 23:51:38.267599 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-49412468-a760-4b8d-92cb-bd581e60eef8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1296 microversion: 2.1 time: 0.468194 Aug 29 23:51:38.271094 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 24/45] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:37 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1293 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:38.285477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:38.286736 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:38.296880 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 22/46] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:37 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1296 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:38.309031 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:38.309240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8424ae9b-db8d-41fc-a5b8-45f588daa177 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:38.309753 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:38.310270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8424ae9b-db8d-41fc-a5b8-45f588daa177 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:38.316868 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:38.318371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:38.325361 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8424ae9b-db8d-41fc-a5b8-45f588daa177 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:38.330015 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8424ae9b-db8d-41fc-a5b8-45f588daa177 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:38.330568 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8424ae9b-db8d-41fc-a5b8-45f588daa177 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:38.331068 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:38.332338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:38.332748 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8424ae9b-db8d-41fc-a5b8-45f588daa177 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:38.335008 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8424ae9b-db8d-41fc-a5b8-45f588daa177 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:38.338295 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8424ae9b-db8d-41fc-a5b8-45f588daa177 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:38.660377 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:38.669040 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8424ae9b-db8d-41fc-a5b8-45f588daa177 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:38.680796 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:38.682858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8424ae9b-db8d-41fc-a5b8-45f588daa177 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1279 microversion: 2.1 time: 0.384683 Aug 29 23:51:38.683941 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 23/47] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:38 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1279 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:38.699737 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:38.701022 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ba710cd4-59af-41dd-8592-ad425fc192b1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1285 microversion: 2.20 time: 0.428417 Aug 29 23:51:38.701780 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 25/48] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:38 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1285 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:38.729441 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-67ea13c6-ab46-4bfd-b861-cc8b8263d958 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:38.730179 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-67ea13c6-ab46-4bfd-b861-cc8b8263d958 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:38.740387 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ea13c6-ab46-4bfd-b861-cc8b8263d958 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:38.740899 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ea13c6-ab46-4bfd-b861-cc8b8263d958 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:38.741332 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ea13c6-ab46-4bfd-b861-cc8b8263d958 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:38.744701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ea13c6-ab46-4bfd-b861-cc8b8263d958 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:38.745196 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ea13c6-ab46-4bfd-b861-cc8b8263d958 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:38.747106 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ea13c6-ab46-4bfd-b861-cc8b8263d958 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:39.127114 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-67ea13c6-ab46-4bfd-b861-cc8b8263d958 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:39.137213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-67ea13c6-ab46-4bfd-b861-cc8b8263d958 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.411737 Aug 29 23:51:39.137903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 24/49] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:38 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:39.294752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6b3aa3f8-252c-4baa-8482-9cd8377b0308 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:39.295323 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6b3aa3f8-252c-4baa-8482-9cd8377b0308 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:39.304791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-884b49fa-9067-4984-aa55-8d3e7cf8eb52 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:39.306317 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-884b49fa-9067-4984-aa55-8d3e7cf8eb52 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:39.306521 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b3aa3f8-252c-4baa-8482-9cd8377b0308 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:39.306943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b3aa3f8-252c-4baa-8482-9cd8377b0308 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:39.307374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b3aa3f8-252c-4baa-8482-9cd8377b0308 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:39.308088 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b3aa3f8-252c-4baa-8482-9cd8377b0308 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:39.308546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b3aa3f8-252c-4baa-8482-9cd8377b0308 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:39.308967 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b3aa3f8-252c-4baa-8482-9cd8377b0308 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:39.315419 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-884b49fa-9067-4984-aa55-8d3e7cf8eb52 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:39.316282 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-884b49fa-9067-4984-aa55-8d3e7cf8eb52 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:39.316967 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-884b49fa-9067-4984-aa55-8d3e7cf8eb52 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:39.319760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-884b49fa-9067-4984-aa55-8d3e7cf8eb52 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:39.320498 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-884b49fa-9067-4984-aa55-8d3e7cf8eb52 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:39.321268 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-884b49fa-9067-4984-aa55-8d3e7cf8eb52 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:39.446303 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-884b49fa-9067-4984-aa55-8d3e7cf8eb52 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:39.453226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-884b49fa-9067-4984-aa55-8d3e7cf8eb52 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1293 microversion: 2.1 time: 0.161568 Aug 29 23:51:39.454654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 25/50] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:39 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:39.547167 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6b3aa3f8-252c-4baa-8482-9cd8377b0308 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:39.553950 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6b3aa3f8-252c-4baa-8482-9cd8377b0308 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.263996 Aug 29 23:51:39.554682 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 26/51] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:39 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:39.731363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:39.731363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:39.731994 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f3c2e5ff-5436-40ac-bbb6-daa22567402c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:39.731994 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f3c2e5ff-5436-40ac-bbb6-daa22567402c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:39.744417 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:39.745001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:39.745260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3c2e5ff-5436-40ac-bbb6-daa22567402c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:39.745846 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:39.745960 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3c2e5ff-5436-40ac-bbb6-daa22567402c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:39.746743 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3c2e5ff-5436-40ac-bbb6-daa22567402c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:39.747118 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:39.747469 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3c2e5ff-5436-40ac-bbb6-daa22567402c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:39.747919 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3c2e5ff-5436-40ac-bbb6-daa22567402c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:39.748124 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:39.748500 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3c2e5ff-5436-40ac-bbb6-daa22567402c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:39.748937 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:39.836273 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:39.844690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:39.846156 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:39.847694 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8fbed634-1351-4013-a1ed-7caf2fa90319 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1285 microversion: 2.20 time: 0.127326 Aug 29 23:51:39.851515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:39 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:39.950188 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f3c2e5ff-5436-40ac-bbb6-daa22567402c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:39.953207 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f3c2e5ff-5436-40ac-bbb6-daa22567402c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.235544 Aug 29 23:51:39.953788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 26/53] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:39 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:40.161773 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1d76f98b-873f-4f44-af9e-b01ef96e1f60 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:40.162474 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1d76f98b-873f-4f44-af9e-b01ef96e1f60 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:40.170145 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d76f98b-873f-4f44-af9e-b01ef96e1f60 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:40.171137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d76f98b-873f-4f44-af9e-b01ef96e1f60 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:40.171907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d76f98b-873f-4f44-af9e-b01ef96e1f60 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:40.172970 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d76f98b-873f-4f44-af9e-b01ef96e1f60 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:40.177104 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d76f98b-873f-4f44-af9e-b01ef96e1f60 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:40.177707 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d76f98b-873f-4f44-af9e-b01ef96e1f60 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:40.373668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1d76f98b-873f-4f44-af9e-b01ef96e1f60 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:40.385635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1d76f98b-873f-4f44-af9e-b01ef96e1f60 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.228420 Aug 29 23:51:40.387478 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 28/54] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:40 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:40.477263 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3553958c-b33b-4ee1-a8bb-7979a274183c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:40.479060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3553958c-b33b-4ee1-a8bb-7979a274183c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:40.486316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3553958c-b33b-4ee1-a8bb-7979a274183c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:40.487132 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3553958c-b33b-4ee1-a8bb-7979a274183c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:40.488312 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3553958c-b33b-4ee1-a8bb-7979a274183c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:40.489636 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3553958c-b33b-4ee1-a8bb-7979a274183c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:40.490155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3553958c-b33b-4ee1-a8bb-7979a274183c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:40.490668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3553958c-b33b-4ee1-a8bb-7979a274183c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:40.573767 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3553958c-b33b-4ee1-a8bb-7979a274183c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:40.576216 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b9cd613a-2b49-4278-985d-dcff47a68df2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:40.576948 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b9cd613a-2b49-4278-985d-dcff47a68df2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:40.585731 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3553958c-b33b-4ee1-a8bb-7979a274183c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1301 microversion: 2.1 time: 0.113117 Aug 29 23:51:40.590949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9cd613a-2b49-4278-985d-dcff47a68df2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:40.595258 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9cd613a-2b49-4278-985d-dcff47a68df2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:40.595807 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9cd613a-2b49-4278-985d-dcff47a68df2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:40.597181 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9cd613a-2b49-4278-985d-dcff47a68df2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:40.597922 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9cd613a-2b49-4278-985d-dcff47a68df2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:40.598825 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9cd613a-2b49-4278-985d-dcff47a68df2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:40.599919 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 27/55] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:40 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1301 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:40.803233 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b9cd613a-2b49-4278-985d-dcff47a68df2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:40.814211 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b9cd613a-2b49-4278-985d-dcff47a68df2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.242130 Aug 29 23:51:40.819076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 29/56] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:40 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:40.876240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:40.876779 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:40.892302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:40.893118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:40.895261 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:40.896213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:40.896830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:40.897401 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:40.977002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9586300c-b139-45ab-994d-e83fa880e51d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:40.977002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9586300c-b139-45ab-994d-e83fa880e51d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:40.979154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:40.986636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9586300c-b139-45ab-994d-e83fa880e51d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:40.987127 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9586300c-b139-45ab-994d-e83fa880e51d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:40.987586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9586300c-b139-45ab-994d-e83fa880e51d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:40.988875 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9586300c-b139-45ab-994d-e83fa880e51d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:40.989304 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9586300c-b139-45ab-994d-e83fa880e51d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:40.989783 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9586300c-b139-45ab-994d-e83fa880e51d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:40.990187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:40.991944 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:41.004367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fe979f82-0dd7-4b16-957e-e94d2f8763e9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1285 microversion: 2.20 time: 0.137084 Aug 29 23:51:41.018949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 28/57] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:40 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:41.184867 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9586300c-b139-45ab-994d-e83fa880e51d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:41.195728 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9586300c-b139-45ab-994d-e83fa880e51d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.224817 Aug 29 23:51:41.199785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 30/58] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:40 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:41.418472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-535031e4-88e8-43df-89af-ccbabeca0dc7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:41.418472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-535031e4-88e8-43df-89af-ccbabeca0dc7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:41.419187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-535031e4-88e8-43df-89af-ccbabeca0dc7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:41.420350 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-535031e4-88e8-43df-89af-ccbabeca0dc7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:41.420884 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-535031e4-88e8-43df-89af-ccbabeca0dc7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:41.421495 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-535031e4-88e8-43df-89af-ccbabeca0dc7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:41.421907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-535031e4-88e8-43df-89af-ccbabeca0dc7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:41.422342 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-535031e4-88e8-43df-89af-ccbabeca0dc7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:41.467096 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:41.622356 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1897076d-4ebc-4873-9c62-da4079ac56dc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:41.623169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1897076d-4ebc-4873-9c62-da4079ac56dc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:41.633932 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1897076d-4ebc-4873-9c62-da4079ac56dc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:41.641585 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1897076d-4ebc-4873-9c62-da4079ac56dc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:41.650715 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1897076d-4ebc-4873-9c62-da4079ac56dc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:41.650715 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1897076d-4ebc-4873-9c62-da4079ac56dc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:41.650715 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1897076d-4ebc-4873-9c62-da4079ac56dc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:41.650715 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1897076d-4ebc-4873-9c62-da4079ac56dc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:41.670455 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-535031e4-88e8-43df-89af-ccbabeca0dc7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:41.679161 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-535031e4-88e8-43df-89af-ccbabeca0dc7 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.272628 Aug 29 23:51:41.680310 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 29/59] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:41 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:41.691981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:41.754918 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1897076d-4ebc-4873-9c62-da4079ac56dc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:41.763125 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1897076d-4ebc-4873-9c62-da4079ac56dc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1301 microversion: 2.1 time: 0.158977 Aug 29 23:51:41.763712 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 31/60] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:41 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1301 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:41.847758 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-58f92852-4340-42a2-b18a-b5f0fdbaf8ad tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:41.848866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-58f92852-4340-42a2-b18a-b5f0fdbaf8ad tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:41.856562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58f92852-4340-42a2-b18a-b5f0fdbaf8ad tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:41.857065 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58f92852-4340-42a2-b18a-b5f0fdbaf8ad tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:41.857497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58f92852-4340-42a2-b18a-b5f0fdbaf8ad tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:41.858390 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58f92852-4340-42a2-b18a-b5f0fdbaf8ad tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:41.858995 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58f92852-4340-42a2-b18a-b5f0fdbaf8ad tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:41.859736 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58f92852-4340-42a2-b18a-b5f0fdbaf8ad tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:42.019901 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-58f92852-4340-42a2-b18a-b5f0fdbaf8ad tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:42.030599 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-58f92852-4340-42a2-b18a-b5f0fdbaf8ad tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.186715 Aug 29 23:51:42.031031 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:42.031951 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:42.032262 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 30/61] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:41 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:42.040098 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:42.041133 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:42.041833 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:42.042782 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:42.043702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:42.044279 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:42.115555 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:42.124996 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:42.126655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:42.132046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-062cd97a-f504-47a5-8d3a-610343ced216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1285 microversion: 2.20 time: 0.102379 Aug 29 23:51:42.132046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:42 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:51:42.217100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-08a81769-7293-48d9-9763-d47cbcc721c7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:42.218030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-08a81769-7293-48d9-9763-d47cbcc721c7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:42.225930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08a81769-7293-48d9-9763-d47cbcc721c7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:42.226695 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08a81769-7293-48d9-9763-d47cbcc721c7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:42.227285 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08a81769-7293-48d9-9763-d47cbcc721c7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:42.228135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08a81769-7293-48d9-9763-d47cbcc721c7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:42.229353 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08a81769-7293-48d9-9763-d47cbcc721c7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:42.229353 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08a81769-7293-48d9-9763-d47cbcc721c7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:42.443558 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-08a81769-7293-48d9-9763-d47cbcc721c7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:42.451397 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-08a81769-7293-48d9-9763-d47cbcc721c7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.238403 Aug 29 23:51:42.451968 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 31/63] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:42 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:42.705702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f29dc252-a3ce-4db4-b2a6-d7768e4fb57c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:42.706312 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f29dc252-a3ce-4db4-b2a6-d7768e4fb57c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:42.713603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f29dc252-a3ce-4db4-b2a6-d7768e4fb57c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:42.716540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f29dc252-a3ce-4db4-b2a6-d7768e4fb57c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:42.716540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f29dc252-a3ce-4db4-b2a6-d7768e4fb57c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:42.716540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f29dc252-a3ce-4db4-b2a6-d7768e4fb57c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:42.716540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f29dc252-a3ce-4db4-b2a6-d7768e4fb57c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:42.716857 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f29dc252-a3ce-4db4-b2a6-d7768e4fb57c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:42.784334 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f31c281c-214d-4a23-ae1e-84e70ff07122 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:42.785562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f31c281c-214d-4a23-ae1e-84e70ff07122 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:42.795637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f31c281c-214d-4a23-ae1e-84e70ff07122 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:42.796128 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f31c281c-214d-4a23-ae1e-84e70ff07122 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:42.796565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f31c281c-214d-4a23-ae1e-84e70ff07122 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:42.797282 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f31c281c-214d-4a23-ae1e-84e70ff07122 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:42.797743 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f31c281c-214d-4a23-ae1e-84e70ff07122 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:42.798154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f31c281c-214d-4a23-ae1e-84e70ff07122 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:42.890152 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f31c281c-214d-4a23-ae1e-84e70ff07122 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:42.912388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f31c281c-214d-4a23-ae1e-84e70ff07122 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1301 microversion: 2.1 time: 0.131412 Aug 29 23:51:42.912735 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f29dc252-a3ce-4db4-b2a6-d7768e4fb57c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:42.914472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 32/64] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:42 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1301 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:42.926661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f29dc252-a3ce-4db4-b2a6-d7768e4fb57c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.226537 Aug 29 23:51:42.927496 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 33/65] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:42 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:43.057568 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-edddfc8d-911b-4cfb-853d-4cc079bacf09 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:43.058351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-edddfc8d-911b-4cfb-853d-4cc079bacf09 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:43.065600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edddfc8d-911b-4cfb-853d-4cc079bacf09 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:43.066666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edddfc8d-911b-4cfb-853d-4cc079bacf09 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:43.067389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edddfc8d-911b-4cfb-853d-4cc079bacf09 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:43.068337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edddfc8d-911b-4cfb-853d-4cc079bacf09 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:43.071965 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edddfc8d-911b-4cfb-853d-4cc079bacf09 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:43.078732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edddfc8d-911b-4cfb-853d-4cc079bacf09 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:43.149138 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=6 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:43.154069 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:43.154901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:43.162003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:43.162836 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:43.163624 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:43.164526 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:43.166606 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:43.167230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:43.320320 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:43.345635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:43.347691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:43.353001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-edddfc8d-911b-4cfb-853d-4cc079bacf09 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:43.354589 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f6070c55-d17d-477c-9702-19e68fd34483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1285 microversion: 2.20 time: 0.203996 Aug 29 23:51:43.354589 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:43 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:43.382885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-edddfc8d-911b-4cfb-853d-4cc079bacf09 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.330302 Aug 29 23:51:43.386473 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 33/67] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:43 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:43.475079 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-72dc00ce-1e9f-415a-8e3c-4ddebaf4ef25 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:43.475956 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-72dc00ce-1e9f-415a-8e3c-4ddebaf4ef25 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:43.484070 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72dc00ce-1e9f-415a-8e3c-4ddebaf4ef25 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:43.491581 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72dc00ce-1e9f-415a-8e3c-4ddebaf4ef25 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:43.492577 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72dc00ce-1e9f-415a-8e3c-4ddebaf4ef25 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:43.495072 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72dc00ce-1e9f-415a-8e3c-4ddebaf4ef25 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:43.499237 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72dc00ce-1e9f-415a-8e3c-4ddebaf4ef25 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:43.499979 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72dc00ce-1e9f-415a-8e3c-4ddebaf4ef25 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:43.741080 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-72dc00ce-1e9f-415a-8e3c-4ddebaf4ef25 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:43.768578 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-72dc00ce-1e9f-415a-8e3c-4ddebaf4ef25 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.298621 Aug 29 23:51:43.769536 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 35/68] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:43 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:43.938777 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ba85ffe4-3d23-4f9e-a562-e6a50be7d25d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:43.940057 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ba85ffe4-3d23-4f9e-a562-e6a50be7d25d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:43.948724 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba85ffe4-3d23-4f9e-a562-e6a50be7d25d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:43.949514 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba85ffe4-3d23-4f9e-a562-e6a50be7d25d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:43.950156 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba85ffe4-3d23-4f9e-a562-e6a50be7d25d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:43.951082 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba85ffe4-3d23-4f9e-a562-e6a50be7d25d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:43.951751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba85ffe4-3d23-4f9e-a562-e6a50be7d25d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:43.952409 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba85ffe4-3d23-4f9e-a562-e6a50be7d25d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:43.952995 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0932b9c6-dd68-46d8-97b3-2c921ddbd0cb tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:43.953708 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0932b9c6-dd68-46d8-97b3-2c921ddbd0cb tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:43.993693 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0932b9c6-dd68-46d8-97b3-2c921ddbd0cb tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:43.994486 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0932b9c6-dd68-46d8-97b3-2c921ddbd0cb tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:43.995182 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0932b9c6-dd68-46d8-97b3-2c921ddbd0cb tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:43.996551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0932b9c6-dd68-46d8-97b3-2c921ddbd0cb tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:43.997270 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0932b9c6-dd68-46d8-97b3-2c921ddbd0cb tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:43.997913 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0932b9c6-dd68-46d8-97b3-2c921ddbd0cb tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:44.046742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ba85ffe4-3d23-4f9e-a562-e6a50be7d25d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:44.054692 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ba85ffe4-3d23-4f9e-a562-e6a50be7d25d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1301 microversion: 2.1 time: 0.121647 Aug 29 23:51:44.056084 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 34/69] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:43 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1301 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:44.266626 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0932b9c6-dd68-46d8-97b3-2c921ddbd0cb tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:44.275221 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0932b9c6-dd68-46d8-97b3-2c921ddbd0cb tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.329910 Aug 29 23:51:44.275960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 36/70] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:43 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:44.387050 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:44.397073 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:44.405110 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8a3cb896-3977-446e-9b67-d19dcfc19060 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:44.405647 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:44.408619 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8a3cb896-3977-446e-9b67-d19dcfc19060 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:44.408816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:44.408816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:44.408816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:44.408816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:44.409307 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:44.421676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a3cb896-3977-446e-9b67-d19dcfc19060 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:44.423145 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a3cb896-3977-446e-9b67-d19dcfc19060 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:44.423958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a3cb896-3977-446e-9b67-d19dcfc19060 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:44.425169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a3cb896-3977-446e-9b67-d19dcfc19060 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:44.426575 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a3cb896-3977-446e-9b67-d19dcfc19060 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:44.427349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a3cb896-3977-446e-9b67-d19dcfc19060 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:44.526301 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:44.548259 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:44.550974 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:44.556643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c6df074d-1ea8-4376-bf03-8a320de2c19a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1285 microversion: 2.20 time: 0.181628 Aug 29 23:51:44.561478 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 35/71] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:44 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:44.682923 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8a3cb896-3977-446e-9b67-d19dcfc19060 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:44.692726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8a3cb896-3977-446e-9b67-d19dcfc19060 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.291198 Aug 29 23:51:44.707008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 37/72] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:44 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:44.795750 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-cf468b52-ee4e-4e14-953b-f1885a43426c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:44.796350 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-cf468b52-ee4e-4e14-953b-f1885a43426c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:44.799531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=6 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:44.803986 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cf468b52-ee4e-4e14-953b-f1885a43426c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:44.804235 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cf468b52-ee4e-4e14-953b-f1885a43426c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:44.804573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cf468b52-ee4e-4e14-953b-f1885a43426c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:44.805469 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cf468b52-ee4e-4e14-953b-f1885a43426c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:44.805973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cf468b52-ee4e-4e14-953b-f1885a43426c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:44.806394 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cf468b52-ee4e-4e14-953b-f1885a43426c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:45.007871 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-cf468b52-ee4e-4e14-953b-f1885a43426c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:45.016470 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-cf468b52-ee4e-4e14-953b-f1885a43426c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.225874 Aug 29 23:51:45.030944 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 36/73] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:44 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:45.087734 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-64000c65-ac4d-4164-b0e4-04f835b28326 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:45.088673 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-64000c65-ac4d-4164-b0e4-04f835b28326 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:45.095032 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-64000c65-ac4d-4164-b0e4-04f835b28326 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:45.095726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-64000c65-ac4d-4164-b0e4-04f835b28326 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:45.096319 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-64000c65-ac4d-4164-b0e4-04f835b28326 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:45.097237 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-64000c65-ac4d-4164-b0e4-04f835b28326 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:45.098476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-64000c65-ac4d-4164-b0e4-04f835b28326 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:45.099061 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-64000c65-ac4d-4164-b0e4-04f835b28326 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:45.203788 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-64000c65-ac4d-4164-b0e4-04f835b28326 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:45.213446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-64000c65-ac4d-4164-b0e4-04f835b28326 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1301 microversion: 2.1 time: 0.130066 Aug 29 23:51:45.221070 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 38/74] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:45 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1301 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:45.301525 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-79801056-fff9-4295-901d-198180eb083e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:45.307556 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-79801056-fff9-4295-901d-198180eb083e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:45.312010 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79801056-fff9-4295-901d-198180eb083e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:45.312570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79801056-fff9-4295-901d-198180eb083e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:45.313069 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79801056-fff9-4295-901d-198180eb083e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:45.313983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79801056-fff9-4295-901d-198180eb083e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:45.314602 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79801056-fff9-4295-901d-198180eb083e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:45.314984 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79801056-fff9-4295-901d-198180eb083e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:45.522391 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-79801056-fff9-4295-901d-198180eb083e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:45.531402 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-79801056-fff9-4295-901d-198180eb083e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.237336 Aug 29 23:51:45.532965 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 37/75] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:45 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:45.587872 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:45.588586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:45.596907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:45.598291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:45.598978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:45.600158 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:45.600852 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:45.601470 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:45.697360 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:45.706322 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:45.708768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:45.710242 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2d155930-0d4e-4f35-9e0d-f80c474a0581 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1285 microversion: 2.20 time: 0.126372 Aug 29 23:51:45.714471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:45 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:51:45.714679 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-42a3fd51-eb32-4e2d-a10b-7126634d2e67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:45.714679 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-42a3fd51-eb32-4e2d-a10b-7126634d2e67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:45.722107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-42a3fd51-eb32-4e2d-a10b-7126634d2e67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:45.722885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-42a3fd51-eb32-4e2d-a10b-7126634d2e67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:45.726316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-42a3fd51-eb32-4e2d-a10b-7126634d2e67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:45.726316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-42a3fd51-eb32-4e2d-a10b-7126634d2e67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:45.726316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-42a3fd51-eb32-4e2d-a10b-7126634d2e67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:45.726316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-42a3fd51-eb32-4e2d-a10b-7126634d2e67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:45.929603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-42a3fd51-eb32-4e2d-a10b-7126634d2e67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:45.938127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-42a3fd51-eb32-4e2d-a10b-7126634d2e67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.228278 Aug 29 23:51:45.939054 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 38/77] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:45 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:46.040704 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0d60bb2b-5829-4481-b14d-692f61ea0ac3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:46.041711 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0d60bb2b-5829-4481-b14d-692f61ea0ac3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:46.044054 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=34 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:46.049679 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d60bb2b-5829-4481-b14d-692f61ea0ac3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:46.056403 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d60bb2b-5829-4481-b14d-692f61ea0ac3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:46.057092 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d60bb2b-5829-4481-b14d-692f61ea0ac3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:46.058001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d60bb2b-5829-4481-b14d-692f61ea0ac3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:46.058482 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d60bb2b-5829-4481-b14d-692f61ea0ac3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:46.059080 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d60bb2b-5829-4481-b14d-692f61ea0ac3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:46.235001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0d60bb2b-5829-4481-b14d-692f61ea0ac3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:46.238679 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-32180560-4d5b-4647-8f14-34e986f571f7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:46.240304 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-32180560-4d5b-4647-8f14-34e986f571f7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:46.244467 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0d60bb2b-5829-4481-b14d-692f61ea0ac3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.209394 Aug 29 23:51:46.245483 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 40/78] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:46 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:46.248302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-32180560-4d5b-4647-8f14-34e986f571f7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:46.249057 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-32180560-4d5b-4647-8f14-34e986f571f7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:46.249751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-32180560-4d5b-4647-8f14-34e986f571f7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:46.250827 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-32180560-4d5b-4647-8f14-34e986f571f7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:46.251474 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-32180560-4d5b-4647-8f14-34e986f571f7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:46.252102 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-32180560-4d5b-4647-8f14-34e986f571f7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:46.338634 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-32180560-4d5b-4647-8f14-34e986f571f7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:46.354652 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-32180560-4d5b-4647-8f14-34e986f571f7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1301 microversion: 2.1 time: 0.123208 Aug 29 23:51:46.355345 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 39/79] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:46 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1301 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:46.556035 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3a727864-84a2-4b64-8b68-70eff32e5aa1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:46.556679 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3a727864-84a2-4b64-8b68-70eff32e5aa1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:46.562831 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3a727864-84a2-4b64-8b68-70eff32e5aa1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:46.563316 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3a727864-84a2-4b64-8b68-70eff32e5aa1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:46.563744 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3a727864-84a2-4b64-8b68-70eff32e5aa1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:46.564439 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3a727864-84a2-4b64-8b68-70eff32e5aa1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:46.564882 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3a727864-84a2-4b64-8b68-70eff32e5aa1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:46.565301 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3a727864-84a2-4b64-8b68-70eff32e5aa1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:46.735522 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:46.736174 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:46.747403 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:46.751433 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:46.754773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:46.754773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:46.754773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:46.754773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:46.760190 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3a727864-84a2-4b64-8b68-70eff32e5aa1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:46.773488 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3a727864-84a2-4b64-8b68-70eff32e5aa1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.221194 Aug 29 23:51:46.774518 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 41/80] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:46 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:46.844434 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:46.853260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:46.854749 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:46.855866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e4f6a654-ca62-4eef-b16c-3d80760e54b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1285 microversion: 2.20 time: 0.126565 Aug 29 23:51:46.856617 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 40/81] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:46 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:46.960943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1161a796-c410-4d3e-be2a-185d0442f85c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:46.961922 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1161a796-c410-4d3e-be2a-185d0442f85c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:46.968334 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1161a796-c410-4d3e-be2a-185d0442f85c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:46.968830 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1161a796-c410-4d3e-be2a-185d0442f85c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:46.969263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1161a796-c410-4d3e-be2a-185d0442f85c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:46.969964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1161a796-c410-4d3e-be2a-185d0442f85c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:46.970415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1161a796-c410-4d3e-be2a-185d0442f85c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:46.970968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1161a796-c410-4d3e-be2a-185d0442f85c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:47.267680 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9ef28677-a57b-46b6-8da8-98dc67fa1ec8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:47.269760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9ef28677-a57b-46b6-8da8-98dc67fa1ec8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:47.272622 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=32 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:47.279429 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ef28677-a57b-46b6-8da8-98dc67fa1ec8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:47.281867 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ef28677-a57b-46b6-8da8-98dc67fa1ec8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:47.282637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ef28677-a57b-46b6-8da8-98dc67fa1ec8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:47.284914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ef28677-a57b-46b6-8da8-98dc67fa1ec8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:47.286410 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ef28677-a57b-46b6-8da8-98dc67fa1ec8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:47.287805 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ef28677-a57b-46b6-8da8-98dc67fa1ec8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:47.344249 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1161a796-c410-4d3e-be2a-185d0442f85c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:47.358192 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1161a796-c410-4d3e-be2a-185d0442f85c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.397542 Aug 29 23:51:47.358192 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 42/82] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:46 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:47.381887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-306fdc2f-42fb-4fc9-84b2-3210ef6db4a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:47.386405 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-306fdc2f-42fb-4fc9-84b2-3210ef6db4a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:47.405115 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-306fdc2f-42fb-4fc9-84b2-3210ef6db4a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:47.410520 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-306fdc2f-42fb-4fc9-84b2-3210ef6db4a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:47.410520 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-306fdc2f-42fb-4fc9-84b2-3210ef6db4a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:47.410520 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-306fdc2f-42fb-4fc9-84b2-3210ef6db4a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:47.410520 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-306fdc2f-42fb-4fc9-84b2-3210ef6db4a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:47.410898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-306fdc2f-42fb-4fc9-84b2-3210ef6db4a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:47.493943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-306fdc2f-42fb-4fc9-84b2-3210ef6db4a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:47.504945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-306fdc2f-42fb-4fc9-84b2-3210ef6db4a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1301 microversion: 2.1 time: 0.130945 Aug 29 23:51:47.519455 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 43/83] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:47 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1301 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:47.530257 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9ef28677-a57b-46b6-8da8-98dc67fa1ec8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:47.542292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9ef28677-a57b-46b6-8da8-98dc67fa1ec8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.279743 Aug 29 23:51:47.543396 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 41/84] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:47 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:47.796927 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2c12a220-0802-48f7-bf6d-3ed3ff8f7ac1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:47.797681 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2c12a220-0802-48f7-bf6d-3ed3ff8f7ac1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:47.804369 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c12a220-0802-48f7-bf6d-3ed3ff8f7ac1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:47.804853 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c12a220-0802-48f7-bf6d-3ed3ff8f7ac1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:47.805460 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c12a220-0802-48f7-bf6d-3ed3ff8f7ac1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:47.806196 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c12a220-0802-48f7-bf6d-3ed3ff8f7ac1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:47.806865 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c12a220-0802-48f7-bf6d-3ed3ff8f7ac1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:47.807319 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c12a220-0802-48f7-bf6d-3ed3ff8f7ac1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:47.879907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:47.880819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:47.895977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:47.897001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:47.897691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:47.898249 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:47.899049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:47.899624 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:48.030698 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:48.031825 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2c12a220-0802-48f7-bf6d-3ed3ff8f7ac1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:48.040392 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:48.042545 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:48.043872 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-29a8dd03-3109-4c28-83eb-e68c60a42df1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1285 microversion: 2.20 time: 0.169083 Aug 29 23:51:48.060211 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 42/85] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:47 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:51:48.062149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2c12a220-0802-48f7-bf6d-3ed3ff8f7ac1 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.269685 Aug 29 23:51:48.084352 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 44/86] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:47 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:48.376324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a95ef68f-384e-480c-a1f8-c38da1d26ff0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:48.376999 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a95ef68f-384e-480c-a1f8-c38da1d26ff0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:48.384110 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a95ef68f-384e-480c-a1f8-c38da1d26ff0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:48.384791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a95ef68f-384e-480c-a1f8-c38da1d26ff0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:48.385339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a95ef68f-384e-480c-a1f8-c38da1d26ff0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:48.386298 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a95ef68f-384e-480c-a1f8-c38da1d26ff0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:48.386868 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a95ef68f-384e-480c-a1f8-c38da1d26ff0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:48.387420 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a95ef68f-384e-480c-a1f8-c38da1d26ff0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:48.526637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a95ef68f-384e-480c-a1f8-c38da1d26ff0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:48.527230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cd2ca227-18ea-436d-9a7d-349e0696f4fc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:48.527980 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-cd2ca227-18ea-436d-9a7d-349e0696f4fc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:48.535037 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cd2ca227-18ea-436d-9a7d-349e0696f4fc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:48.543481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cd2ca227-18ea-436d-9a7d-349e0696f4fc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:48.543481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cd2ca227-18ea-436d-9a7d-349e0696f4fc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:48.543481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cd2ca227-18ea-436d-9a7d-349e0696f4fc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:48.543481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cd2ca227-18ea-436d-9a7d-349e0696f4fc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:48.543941 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cd2ca227-18ea-436d-9a7d-349e0696f4fc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:48.546004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a95ef68f-384e-480c-a1f8-c38da1d26ff0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.173716 Aug 29 23:51:48.547296 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 43/87] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:48 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:48.565734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-435e98c6-d000-4f2c-b6e7-16dcc5d8c3ff tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:48.566352 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-435e98c6-d000-4f2c-b6e7-16dcc5d8c3ff tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:48.573468 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-435e98c6-d000-4f2c-b6e7-16dcc5d8c3ff tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:48.573952 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-435e98c6-d000-4f2c-b6e7-16dcc5d8c3ff tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:48.574388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-435e98c6-d000-4f2c-b6e7-16dcc5d8c3ff tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:48.575371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-435e98c6-d000-4f2c-b6e7-16dcc5d8c3ff tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:48.576001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-435e98c6-d000-4f2c-b6e7-16dcc5d8c3ff tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:48.576425 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-435e98c6-d000-4f2c-b6e7-16dcc5d8c3ff tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:48.621849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-cd2ca227-18ea-436d-9a7d-349e0696f4fc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:48.639394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-cd2ca227-18ea-436d-9a7d-349e0696f4fc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1301 microversion: 2.1 time: 0.116301 Aug 29 23:51:48.640635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 45/88] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:48 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1301 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:48.734140 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-435e98c6-d000-4f2c-b6e7-16dcc5d8c3ff tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:48.743535 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-435e98c6-d000-4f2c-b6e7-16dcc5d8c3ff tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.182565 Aug 29 23:51:48.744096 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 44/89] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:48 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:49.071437 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:49.073620 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:49.081984 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:49.082939 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:49.083592 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:49.084704 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:49.085171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:49.085702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:49.094181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c896bdf6-d38c-44d0-a008-e7be5da4574b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:49.094869 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c896bdf6-d38c-44d0-a008-e7be5da4574b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:49.104075 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c896bdf6-d38c-44d0-a008-e7be5da4574b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:49.106767 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c896bdf6-d38c-44d0-a008-e7be5da4574b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:49.107220 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c896bdf6-d38c-44d0-a008-e7be5da4574b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:49.112306 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c896bdf6-d38c-44d0-a008-e7be5da4574b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:49.112933 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c896bdf6-d38c-44d0-a008-e7be5da4574b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:49.114280 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c896bdf6-d38c-44d0-a008-e7be5da4574b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:49.350554 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:49.362281 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:49.366796 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:49.367948 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3f16bae6-364f-49ea-a7c0-ea642641e1f5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1285 microversion: 2.20 time: 0.303233 Aug 29 23:51:49.368513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 46/90] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:49 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1285 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:49.570143 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-60cc2b0b-d99b-462c-9090-53b724b7a944 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:49.570871 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-60cc2b0b-d99b-462c-9090-53b724b7a944 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:49.583772 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c896bdf6-d38c-44d0-a008-e7be5da4574b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:49.591374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60cc2b0b-d99b-462c-9090-53b724b7a944 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:49.591872 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60cc2b0b-d99b-462c-9090-53b724b7a944 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:49.592495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60cc2b0b-d99b-462c-9090-53b724b7a944 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:49.593359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60cc2b0b-d99b-462c-9090-53b724b7a944 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:49.593819 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60cc2b0b-d99b-462c-9090-53b724b7a944 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:49.594303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60cc2b0b-d99b-462c-9090-53b724b7a944 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:49.603356 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c896bdf6-d38c-44d0-a008-e7be5da4574b tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.513256 Aug 29 23:51:49.608717 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 45/91] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:49 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:49.665854 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-27ff3040-8ba4-47ed-b6b9-6868c8804467 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:49.666621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-27ff3040-8ba4-47ed-b6b9-6868c8804467 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:49.678752 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-27ff3040-8ba4-47ed-b6b9-6868c8804467 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:49.679258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-27ff3040-8ba4-47ed-b6b9-6868c8804467 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:49.680848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-27ff3040-8ba4-47ed-b6b9-6868c8804467 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:49.683984 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-27ff3040-8ba4-47ed-b6b9-6868c8804467 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:49.684703 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-27ff3040-8ba4-47ed-b6b9-6868c8804467 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:49.685517 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-27ff3040-8ba4-47ed-b6b9-6868c8804467 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:49.695894 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:49.933820 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-27ff3040-8ba4-47ed-b6b9-6868c8804467 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:49.949958 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-27ff3040-8ba4-47ed-b6b9-6868c8804467 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1299 microversion: 2.1 time: 0.290701 Aug 29 23:51:49.951203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 46/92] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:49 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1299 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:49.966630 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d802d69b-e9fe-425d-b17f-4127d1584cf9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:49.968049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d802d69b-e9fe-425d-b17f-4127d1584cf9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:49.978817 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d802d69b-e9fe-425d-b17f-4127d1584cf9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:49.979615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d802d69b-e9fe-425d-b17f-4127d1584cf9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:49.980415 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d802d69b-e9fe-425d-b17f-4127d1584cf9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:49.981288 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d802d69b-e9fe-425d-b17f-4127d1584cf9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:49.981868 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d802d69b-e9fe-425d-b17f-4127d1584cf9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:49.983562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d802d69b-e9fe-425d-b17f-4127d1584cf9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:50.029364 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-60cc2b0b-d99b-462c-9090-53b724b7a944 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:50.038239 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-60cc2b0b-d99b-462c-9090-53b724b7a944 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.473009 Aug 29 23:51:50.042602 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 47/93] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:49 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:50.236336 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d802d69b-e9fe-425d-b17f-4127d1584cf9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:50.244735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d802d69b-e9fe-425d-b17f-4127d1584cf9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.292278 Aug 29 23:51:50.245301 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 47/94] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:49 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:50.397395 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:50.398955 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:50.411160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:50.412503 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:50.414254 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:50.415386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:50.416741 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:50.417446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:50.425478 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:50.624991 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d05b254c-cd2e-40b4-9696-b8a9392cee2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:50.626504 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d05b254c-cd2e-40b4-9696-b8a9392cee2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:50.627329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:50.638366 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d05b254c-cd2e-40b4-9696-b8a9392cee2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:50.642238 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:50.644016 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d05b254c-cd2e-40b4-9696-b8a9392cee2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:50.644565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d05b254c-cd2e-40b4-9696-b8a9392cee2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:50.644729 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:50.646204 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c5683d75-3fe1-4346-8a31-7c07dc58fa12 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1333 microversion: 2.20 time: 0.257692 Aug 29 23:51:50.646799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d05b254c-cd2e-40b4-9696-b8a9392cee2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:50.647694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d05b254c-cd2e-40b4-9696-b8a9392cee2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:50.648406 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d05b254c-cd2e-40b4-9696-b8a9392cee2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:50.651002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 48/95] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:50 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1333 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:50.980207 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3957c990-e068-4ebf-a956-a48b0e08b49f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:50.981286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3957c990-e068-4ebf-a956-a48b0e08b49f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:50.991636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3957c990-e068-4ebf-a956-a48b0e08b49f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:50.995821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3957c990-e068-4ebf-a956-a48b0e08b49f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:50.996629 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3957c990-e068-4ebf-a956-a48b0e08b49f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:50.998935 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3957c990-e068-4ebf-a956-a48b0e08b49f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:51.002145 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3957c990-e068-4ebf-a956-a48b0e08b49f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:51.003097 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3957c990-e068-4ebf-a956-a48b0e08b49f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:51.403183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d05b254c-cd2e-40b4-9696-b8a9392cee2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:51.418622 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d05b254c-cd2e-40b4-9696-b8a9392cee2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.798007 Aug 29 23:51:51.419200 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 48/96] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:50 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:51.449160 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2f03de8d-e95b-43ec-91d7-4608859a10ee tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:51.450860 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2f03de8d-e95b-43ec-91d7-4608859a10ee tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:51.463463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f03de8d-e95b-43ec-91d7-4608859a10ee tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:51.470287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f03de8d-e95b-43ec-91d7-4608859a10ee tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:51.470765 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f03de8d-e95b-43ec-91d7-4608859a10ee tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:51.471515 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f03de8d-e95b-43ec-91d7-4608859a10ee tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:51.471957 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f03de8d-e95b-43ec-91d7-4608859a10ee tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:51.472374 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f03de8d-e95b-43ec-91d7-4608859a10ee tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.092698 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3957c990-e068-4ebf-a956-a48b0e08b49f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:52.103503 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3957c990-e068-4ebf-a956-a48b0e08b49f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 1.128015 Aug 29 23:51:52.104600 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 49/97] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:50 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:52.109434 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ec46c639-e925-4cc5-9929-2ffed423beed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:52.110030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ec46c639-e925-4cc5-9929-2ffed423beed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:52.126085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ec46c639-e925-4cc5-9929-2ffed423beed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.132759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ec46c639-e925-4cc5-9929-2ffed423beed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.132759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ec46c639-e925-4cc5-9929-2ffed423beed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.132759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ec46c639-e925-4cc5-9929-2ffed423beed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.132759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ec46c639-e925-4cc5-9929-2ffed423beed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.133170 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ec46c639-e925-4cc5-9929-2ffed423beed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.212076 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2f03de8d-e95b-43ec-91d7-4608859a10ee tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:52.222126 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2f03de8d-e95b-43ec-91d7-4608859a10ee tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.799837 Aug 29 23:51:52.222851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 49/98] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:51 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:52.228736 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:52.229827 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:52.237425 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.238362 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.239219 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.240628 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.241309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.242004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.437941 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:52.449075 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:52.451116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:52.452329 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4cee7388-ab42-489e-b7e4-908744c35983 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1339 microversion: 2.20 time: 0.228319 Aug 29 23:51:52.452896 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 50/99] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:52 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1339 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:52.669548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ec46c639-e925-4cc5-9929-2ffed423beed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:52.675067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-3ba41298-bccd-460e-bcf1-4d6404f405ab req-64b845fa-d6fc-47b9-9468-0c24811d3286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a", "tag": "f1ec22c6-261a-4c67-84d2-31f8a47e0693"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:52.679022 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ec46c639-e925-4cc5-9929-2ffed423beed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.573187 Aug 29 23:51:52.695359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 50/100] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:52 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:52.704419 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-3ba41298-bccd-460e-bcf1-4d6404f405ab req-64b845fa-d6fc-47b9-9468-0c24811d3286 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.705040 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-3ba41298-bccd-460e-bcf1-4d6404f405ab req-64b845fa-d6fc-47b9-9468-0c24811d3286 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.705463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-3ba41298-bccd-460e-bcf1-4d6404f405ab req-64b845fa-d6fc-47b9-9468-0c24811d3286 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.758197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-3ba41298-bccd-460e-bcf1-4d6404f405ab req-64b845fa-d6fc-47b9-9468-0c24811d3286 service nova] Creating event network-changed:f1ec22c6-261a-4c67-84d2-31f8a47e0693 for instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a on hv-cinder-85427 Aug 29 23:51:52.759135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-3ba41298-bccd-460e-bcf1-4d6404f405ab req-64b845fa-d6fc-47b9-9468-0c24811d3286 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 23:51:52.759866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-3ba41298-bccd-460e-bcf1-4d6404f405ab req-64b845fa-d6fc-47b9-9468-0c24811d3286 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 23:51:52.761178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70f30065-65b2-4e6c-ae82-3633459cff4a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.761896 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70f30065-65b2-4e6c-ae82-3633459cff4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.762557 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70f30065-65b2-4e6c-ae82-3633459cff4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.763511 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70f30065-65b2-4e6c-ae82-3633459cff4a None None] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.764181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70f30065-65b2-4e6c-ae82-3633459cff4a None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.764787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70f30065-65b2-4e6c-ae82-3633459cff4a None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.775203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.compute.rpcapi [None req-70f30065-65b2-4e6c-ae82-3633459cff4a None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 23:51:52.776498 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70f30065-65b2-4e6c-ae82-3633459cff4a None None] Releasing lock "compute-rpcapi-router" {{(pid=127705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 23:51:52.797538 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-70f30065-65b2-4e6c-ae82-3633459cff4a None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.342549 Aug 29 23:51:52.798316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 51/101] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:51:52.804374 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5ce2770c-680a-40cf-968c-a6e50e7eefc0 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:52.805449 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-5ce2770c-680a-40cf-968c-a6e50e7eefc0 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:52.812445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5ce2770c-680a-40cf-968c-a6e50e7eefc0 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.813372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5ce2770c-680a-40cf-968c-a6e50e7eefc0 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.814041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5ce2770c-680a-40cf-968c-a6e50e7eefc0 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.814970 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5ce2770c-680a-40cf-968c-a6e50e7eefc0 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.815597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5ce2770c-680a-40cf-968c-a6e50e7eefc0 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.816213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5ce2770c-680a-40cf-968c-a6e50e7eefc0 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.955105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-309a220d-03e4-4791-9b49-c5cee0a687eb req-6279306e-845c-4bb4-a984-aad51d85ecd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8ec8e13-8f80-45fd-a17c-02fdc4737427", "tag": "f40880ff-7fed-43ae-a195-d6745bc86dde"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:52.970686 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-309a220d-03e4-4791-9b49-c5cee0a687eb req-6279306e-845c-4bb4-a984-aad51d85ecd7 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.971374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-309a220d-03e4-4791-9b49-c5cee0a687eb req-6279306e-845c-4bb4-a984-aad51d85ecd7 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.971981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-309a220d-03e4-4791-9b49-c5cee0a687eb req-6279306e-845c-4bb4-a984-aad51d85ecd7 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.998812 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-309a220d-03e4-4791-9b49-c5cee0a687eb req-6279306e-845c-4bb4-a984-aad51d85ecd7 service nova] Creating event network-changed:f40880ff-7fed-43ae-a195-d6745bc86dde for instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 on hv-cinder-85427 Aug 29 23:51:52.998812 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-309a220d-03e4-4791-9b49-c5cee0a687eb req-6279306e-845c-4bb4-a984-aad51d85ecd7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 23:51:52.998812 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-309a220d-03e4-4791-9b49-c5cee0a687eb req-6279306e-845c-4bb4-a984-aad51d85ecd7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 23:51:52.998812 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa7b914a-742f-4803-a1a7-63cda153c1f0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:52.998812 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa7b914a-742f-4803-a1a7-63cda153c1f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:52.999286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa7b914a-742f-4803-a1a7-63cda153c1f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:52.999603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa7b914a-742f-4803-a1a7-63cda153c1f0 None None] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:53.000294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa7b914a-742f-4803-a1a7-63cda153c1f0 None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:53.000778 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa7b914a-742f-4803-a1a7-63cda153c1f0 None None] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:53.013470 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.compute.rpcapi [None req-fa7b914a-742f-4803-a1a7-63cda153c1f0 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 23:51:53.014767 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa7b914a-742f-4803-a1a7-63cda153c1f0 None None] Releasing lock "compute-rpcapi-router" {{(pid=127706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 23:51:53.037213 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-fa7b914a-742f-4803-a1a7-63cda153c1f0 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.340049 Aug 29 23:51:53.039590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 51/102] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:51:53.090782 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5ce2770c-680a-40cf-968c-a6e50e7eefc0 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:53.096903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5ce2770c-680a-40cf-968c-a6e50e7eefc0 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.297081 Aug 29 23:51:53.097704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 52/103] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:52 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:53.128703 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-590f2764-e7fb-4ec2-83ce-8c51314893bd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:53.130312 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-590f2764-e7fb-4ec2-83ce-8c51314893bd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:53.137862 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-590f2764-e7fb-4ec2-83ce-8c51314893bd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:53.138893 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-590f2764-e7fb-4ec2-83ce-8c51314893bd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:53.139608 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-590f2764-e7fb-4ec2-83ce-8c51314893bd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:53.140744 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-590f2764-e7fb-4ec2-83ce-8c51314893bd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:53.141750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-590f2764-e7fb-4ec2-83ce-8c51314893bd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:53.142399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-590f2764-e7fb-4ec2-83ce-8c51314893bd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:53.244482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1ae871d4-ce1b-493f-baa6-c10b1b7146fe tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:53.245154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1ae871d4-ce1b-493f-baa6-c10b1b7146fe tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:53.254522 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1ae871d4-ce1b-493f-baa6-c10b1b7146fe tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:53.255025 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1ae871d4-ce1b-493f-baa6-c10b1b7146fe tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:53.256291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1ae871d4-ce1b-493f-baa6-c10b1b7146fe tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:53.258843 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1ae871d4-ce1b-493f-baa6-c10b1b7146fe tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:53.259557 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1ae871d4-ce1b-493f-baa6-c10b1b7146fe tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:53.262277 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1ae871d4-ce1b-493f-baa6-c10b1b7146fe tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:53.452624 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-590f2764-e7fb-4ec2-83ce-8c51314893bd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:53.469490 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-590f2764-e7fb-4ec2-83ce-8c51314893bd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.345266 Aug 29 23:51:53.469490 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 52/104] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:53 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:53.484109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1ae871d4-ce1b-493f-baa6-c10b1b7146fe tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:53.488407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:53.488407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:53.498331 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1ae871d4-ce1b-493f-baa6-c10b1b7146fe tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.254180 Aug 29 23:51:53.498331 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 53/105] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:53 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:53.498811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:53.498811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:53.498811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:53.498811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:53.499302 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:53.499302 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:53.574015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:53.583761 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:53.585294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:53.586415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3786b31c-f84b-44cc-9e7b-03566d0adca0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1339 microversion: 2.20 time: 0.103409 Aug 29 23:51:53.587011 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 53/106] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:53 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:53.708343 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7211ab5d-2763-4b7f-a528-a6daaa4e2c8e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:53.710031 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7211ab5d-2763-4b7f-a528-a6daaa4e2c8e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:53.717055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7211ab5d-2763-4b7f-a528-a6daaa4e2c8e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:53.731618 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7211ab5d-2763-4b7f-a528-a6daaa4e2c8e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:53.732279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7211ab5d-2763-4b7f-a528-a6daaa4e2c8e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:53.733011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7211ab5d-2763-4b7f-a528-a6daaa4e2c8e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:53.737991 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7211ab5d-2763-4b7f-a528-a6daaa4e2c8e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:53.738895 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7211ab5d-2763-4b7f-a528-a6daaa4e2c8e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:53.904179 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7211ab5d-2763-4b7f-a528-a6daaa4e2c8e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:53.913691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7211ab5d-2763-4b7f-a528-a6daaa4e2c8e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.210682 Aug 29 23:51:53.930805 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 54/107] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:53 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:54.119847 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-da413ee3-b4e4-43f4-88f1-eca4418ac1db tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:54.126104 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-da413ee3-b4e4-43f4-88f1-eca4418ac1db tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:54.126877 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da413ee3-b4e4-43f4-88f1-eca4418ac1db tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:54.127390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da413ee3-b4e4-43f4-88f1-eca4418ac1db tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:54.127811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da413ee3-b4e4-43f4-88f1-eca4418ac1db tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:54.128504 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da413ee3-b4e4-43f4-88f1-eca4418ac1db tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:54.129550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da413ee3-b4e4-43f4-88f1-eca4418ac1db tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:54.130280 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da413ee3-b4e4-43f4-88f1-eca4418ac1db tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:54.364587 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-da413ee3-b4e4-43f4-88f1-eca4418ac1db tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:54.388359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-da413ee3-b4e4-43f4-88f1-eca4418ac1db tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.268893 Aug 29 23:51:54.398365 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 54/108] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:54 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:54.488295 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-77ff3e37-0356-470a-a344-085a6b9c3c99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:54.489531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-77ff3e37-0356-470a-a344-085a6b9c3c99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:54.495805 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77ff3e37-0356-470a-a344-085a6b9c3c99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:54.496287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77ff3e37-0356-470a-a344-085a6b9c3c99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:54.496729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77ff3e37-0356-470a-a344-085a6b9c3c99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:54.497605 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77ff3e37-0356-470a-a344-085a6b9c3c99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:54.498202 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77ff3e37-0356-470a-a344-085a6b9c3c99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:54.498648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77ff3e37-0356-470a-a344-085a6b9c3c99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:54.519384 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e31ce7e0-ca57-4aeb-8101-f59b61efa3b2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:54.521866 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e31ce7e0-ca57-4aeb-8101-f59b61efa3b2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:54.528802 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e31ce7e0-ca57-4aeb-8101-f59b61efa3b2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:54.529835 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e31ce7e0-ca57-4aeb-8101-f59b61efa3b2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:54.530499 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e31ce7e0-ca57-4aeb-8101-f59b61efa3b2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:54.531427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e31ce7e0-ca57-4aeb-8101-f59b61efa3b2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:54.532744 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e31ce7e0-ca57-4aeb-8101-f59b61efa3b2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:54.533162 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e31ce7e0-ca57-4aeb-8101-f59b61efa3b2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:55.386225 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-77ff3e37-0356-470a-a344-085a6b9c3c99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:55.394345 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-77ff3e37-0356-470a-a344-085a6b9c3c99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.909799 Aug 29 23:51:55.395565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 55/109] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:54 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:55.427938 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:55.428552 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:55.446502 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:55.447008 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:55.447445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:55.448156 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:55.448609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:55.449032 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:55.471887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e31ce7e0-ca57-4aeb-8101-f59b61efa3b2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:55.482886 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e31ce7e0-ca57-4aeb-8101-f59b61efa3b2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.968534 Aug 29 23:51:55.486922 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 55/110] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:54 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:55.498676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-61c06b69-5bfb-4c16-b5b0-76a620157d70 req-edcb9670-dbb7-45b4-a084-3304714a9ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edecb793-ad02-4b6f-addc-020ce872a118", "tag": "a058a5e2-fffb-402f-99cc-4946054648c3"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:55.523253 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-61c06b69-5bfb-4c16-b5b0-76a620157d70 req-edcb9670-dbb7-45b4-a084-3304714a9ce9 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:55.526972 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-61c06b69-5bfb-4c16-b5b0-76a620157d70 req-edcb9670-dbb7-45b4-a084-3304714a9ce9 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:55.527669 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-61c06b69-5bfb-4c16-b5b0-76a620157d70 req-edcb9670-dbb7-45b4-a084-3304714a9ce9 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:55.560020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-61c06b69-5bfb-4c16-b5b0-76a620157d70 req-edcb9670-dbb7-45b4-a084-3304714a9ce9 service nova] Creating event network-changed:a058a5e2-fffb-402f-99cc-4946054648c3 for instance edecb793-ad02-4b6f-addc-020ce872a118 on hv-cinder-85427 Aug 29 23:51:55.569647 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-61c06b69-5bfb-4c16-b5b0-76a620157d70 req-edcb9670-dbb7-45b4-a084-3304714a9ce9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081065 Aug 29 23:51:55.570559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 56/111] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:51:55.576876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-493f4579-8176-4b0a-9619-e41251f23e4d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:55.577612 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-493f4579-8176-4b0a-9619-e41251f23e4d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:55.585787 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-493f4579-8176-4b0a-9619-e41251f23e4d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:55.586519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-493f4579-8176-4b0a-9619-e41251f23e4d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:55.588123 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-493f4579-8176-4b0a-9619-e41251f23e4d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:55.589044 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-493f4579-8176-4b0a-9619-e41251f23e4d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:55.589850 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-493f4579-8176-4b0a-9619-e41251f23e4d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:55.590486 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-493f4579-8176-4b0a-9619-e41251f23e4d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:55.890195 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:55.906872 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:55.908581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:55.910615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8e81c025-995c-4ae4-a245-c6e4a3951b34 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.486985 Aug 29 23:51:55.912256 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 56/112] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:55 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:55.922573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-493f4579-8176-4b0a-9619-e41251f23e4d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:55.924098 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-493f4579-8176-4b0a-9619-e41251f23e4d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.352103 Aug 29 23:51:55.924922 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 57/113] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:55 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:55.931551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f36f38b1-9830-4b21-b75b-5e5616a9ea1f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:55.932244 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f36f38b1-9830-4b21-b75b-5e5616a9ea1f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:55.932773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-60a38874-14a6-41b2-8af9-cf66cd2b27d2 req-ac106a93-45d9-4850-b010-176f3e5816c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d83695-337c-4680-ac86-9e9aa83f52f0", "tag": "a3bc2dbb-5f57-4183-b6af-6edb5fc60c9c"}, {"name": "network-changed", "server_uuid": "32036006-145d-499d-848e-16bd2f8f9abf", "tag": "01e67dee-c059-44c0-b274-3278a508338c"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:55.945270 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f36f38b1-9830-4b21-b75b-5e5616a9ea1f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:55.945808 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f36f38b1-9830-4b21-b75b-5e5616a9ea1f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:55.946243 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f36f38b1-9830-4b21-b75b-5e5616a9ea1f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:55.947152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f36f38b1-9830-4b21-b75b-5e5616a9ea1f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:55.947789 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f36f38b1-9830-4b21-b75b-5e5616a9ea1f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:55.948380 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f36f38b1-9830-4b21-b75b-5e5616a9ea1f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:55.957631 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-60a38874-14a6-41b2-8af9-cf66cd2b27d2 req-ac106a93-45d9-4850-b010-176f3e5816c3 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:55.960797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-60a38874-14a6-41b2-8af9-cf66cd2b27d2 req-ac106a93-45d9-4850-b010-176f3e5816c3 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:55.960797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-60a38874-14a6-41b2-8af9-cf66cd2b27d2 req-ac106a93-45d9-4850-b010-176f3e5816c3 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:55.999580 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-60a38874-14a6-41b2-8af9-cf66cd2b27d2 req-ac106a93-45d9-4850-b010-176f3e5816c3 service nova] Creating event network-changed:a3bc2dbb-5f57-4183-b6af-6edb5fc60c9c for instance e5d83695-337c-4680-ac86-9e9aa83f52f0 on hv-cinder-85427 Aug 29 23:51:56.000329 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-60a38874-14a6-41b2-8af9-cf66cd2b27d2 req-ac106a93-45d9-4850-b010-176f3e5816c3 service nova] Creating event network-changed:01e67dee-c059-44c0-b274-3278a508338c for instance 32036006-145d-499d-848e-16bd2f8f9abf on hv-cinder-85427 Aug 29 23:51:56.013174 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-60a38874-14a6-41b2-8af9-cf66cd2b27d2 req-ac106a93-45d9-4850-b010-176f3e5816c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088590 Aug 29 23:51:56.013934 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 57/114] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:51:56.362033 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f36f38b1-9830-4b21-b75b-5e5616a9ea1f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:56.372103 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f36f38b1-9830-4b21-b75b-5e5616a9ea1f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.446076 Aug 29 23:51:56.373054 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 58/115] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:55 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:56.622792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-44e4240f-cd22-4514-b169-b8412cb8f431 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:56.622792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-44e4240f-cd22-4514-b169-b8412cb8f431 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:56.622792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44e4240f-cd22-4514-b169-b8412cb8f431 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:56.622792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44e4240f-cd22-4514-b169-b8412cb8f431 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:56.623126 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44e4240f-cd22-4514-b169-b8412cb8f431 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:56.623126 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44e4240f-cd22-4514-b169-b8412cb8f431 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:56.623126 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44e4240f-cd22-4514-b169-b8412cb8f431 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:56.623126 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44e4240f-cd22-4514-b169-b8412cb8f431 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:56.623427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d2f1fefd-860b-4127-8edb-ebdbc4d1d0da tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:56.623427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d2f1fefd-860b-4127-8edb-ebdbc4d1d0da tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:56.623427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2f1fefd-860b-4127-8edb-ebdbc4d1d0da tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:56.623427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2f1fefd-860b-4127-8edb-ebdbc4d1d0da tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:56.624078 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2f1fefd-860b-4127-8edb-ebdbc4d1d0da tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:56.624078 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2f1fefd-860b-4127-8edb-ebdbc4d1d0da tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:56.624078 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2f1fefd-860b-4127-8edb-ebdbc4d1d0da tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:56.624078 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2f1fefd-860b-4127-8edb-ebdbc4d1d0da tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:56.624315 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-44e4240f-cd22-4514-b169-b8412cb8f431 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:56.624315 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-44e4240f-cd22-4514-b169-b8412cb8f431 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.201476 Aug 29 23:51:56.624315 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 58/116] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:56 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:56.681628 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d2f1fefd-860b-4127-8edb-ebdbc4d1d0da tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:56.690335 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d2f1fefd-860b-4127-8edb-ebdbc4d1d0da tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.183910 Aug 29 23:51:56.691180 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 59/117] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:56 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:56.949505 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:56.950131 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:56.955922 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-abb57423-6dd0-4fb1-b913-3d326690c94c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:56.956606 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-abb57423-6dd0-4fb1-b913-3d326690c94c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:56.961076 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:56.961575 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:56.962009 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:56.962754 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:56.963385 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:56.964000 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:56.972737 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-abb57423-6dd0-4fb1-b913-3d326690c94c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:56.973358 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-abb57423-6dd0-4fb1-b913-3d326690c94c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:56.973877 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-abb57423-6dd0-4fb1-b913-3d326690c94c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:56.975203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-abb57423-6dd0-4fb1-b913-3d326690c94c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:56.976006 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-abb57423-6dd0-4fb1-b913-3d326690c94c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:56.976506 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-abb57423-6dd0-4fb1-b913-3d326690c94c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:57.220215 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:57.247161 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:57.250345 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:57.253115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-871147b5-6f00-4c93-865d-8c8764e08bd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.307568 Aug 29 23:51:57.255722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 59/118] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:56 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:51:57.257949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-abb57423-6dd0-4fb1-b913-3d326690c94c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:57.268127 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-abb57423-6dd0-4fb1-b913-3d326690c94c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.319274 Aug 29 23:51:57.294898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 60/119] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:56 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:57.395371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-538cb6fd-54b9-41a3-94d1-69b8cd2cd105 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:57.396252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-538cb6fd-54b9-41a3-94d1-69b8cd2cd105 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:57.404223 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538cb6fd-54b9-41a3-94d1-69b8cd2cd105 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:57.404754 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538cb6fd-54b9-41a3-94d1-69b8cd2cd105 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:57.405432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538cb6fd-54b9-41a3-94d1-69b8cd2cd105 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:57.406246 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538cb6fd-54b9-41a3-94d1-69b8cd2cd105 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:57.407302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538cb6fd-54b9-41a3-94d1-69b8cd2cd105 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:57.407816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538cb6fd-54b9-41a3-94d1-69b8cd2cd105 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:57.586236 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-538cb6fd-54b9-41a3-94d1-69b8cd2cd105 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:57.596792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-538cb6fd-54b9-41a3-94d1-69b8cd2cd105 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.204070 Aug 29 23:51:57.596792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 60/120] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:57 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:57.638333 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5cecb8b3-59dd-48bf-b3ec-12282a3ca4b5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:57.639039 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5cecb8b3-59dd-48bf-b3ec-12282a3ca4b5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:57.645843 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cecb8b3-59dd-48bf-b3ec-12282a3ca4b5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:57.648060 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cecb8b3-59dd-48bf-b3ec-12282a3ca4b5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:57.648508 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cecb8b3-59dd-48bf-b3ec-12282a3ca4b5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:57.649333 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cecb8b3-59dd-48bf-b3ec-12282a3ca4b5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:57.649884 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cecb8b3-59dd-48bf-b3ec-12282a3ca4b5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:57.650481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cecb8b3-59dd-48bf-b3ec-12282a3ca4b5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:57.718408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-95ed2836-cd6a-4d26-932c-15c7f9095df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:57.719851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-95ed2836-cd6a-4d26-932c-15c7f9095df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:57.728322 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95ed2836-cd6a-4d26-932c-15c7f9095df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:57.729762 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95ed2836-cd6a-4d26-932c-15c7f9095df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:57.729762 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95ed2836-cd6a-4d26-932c-15c7f9095df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:57.730304 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95ed2836-cd6a-4d26-932c-15c7f9095df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:57.730796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95ed2836-cd6a-4d26-932c-15c7f9095df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:57.731218 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95ed2836-cd6a-4d26-932c-15c7f9095df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:58.091675 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5cecb8b3-59dd-48bf-b3ec-12282a3ca4b5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:58.108551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5cecb8b3-59dd-48bf-b3ec-12282a3ca4b5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.475000 Aug 29 23:51:58.109149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 61/121] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:57 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:58.149200 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-95ed2836-cd6a-4d26-932c-15c7f9095df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:58.161423 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-95ed2836-cd6a-4d26-932c-15c7f9095df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.447824 Aug 29 23:51:58.162057 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 61/122] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:57 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:58.167800 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-62b88525-7b4c-401c-b2d6-f02867f5d7f2 req-5d096710-8e3f-4c9a-8a5d-ee10aa399437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781bf4fc-f6e6-4efc-b757-5888339b6b3c", "tag": "70011c53-2246-46a9-9308-734ee213614a"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:58.180271 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-62b88525-7b4c-401c-b2d6-f02867f5d7f2 req-5d096710-8e3f-4c9a-8a5d-ee10aa399437 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:58.181412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-62b88525-7b4c-401c-b2d6-f02867f5d7f2 req-5d096710-8e3f-4c9a-8a5d-ee10aa399437 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:58.182202 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-62b88525-7b4c-401c-b2d6-f02867f5d7f2 req-5d096710-8e3f-4c9a-8a5d-ee10aa399437 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:58.197048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-62b88525-7b4c-401c-b2d6-f02867f5d7f2 req-5d096710-8e3f-4c9a-8a5d-ee10aa399437 service nova] Creating event network-changed:70011c53-2246-46a9-9308-734ee213614a for instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c on hv-cinder-85427 Aug 29 23:51:58.204789 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-62b88525-7b4c-401c-b2d6-f02867f5d7f2 req-5d096710-8e3f-4c9a-8a5d-ee10aa399437 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040704 Aug 29 23:51:58.205682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 62/123] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:51:58.277873 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:58.278635 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:58.284878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:58.285671 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:58.286273 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:58.287144 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:58.287597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:58.288014 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:58.483290 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-65bbc657-c315-4556-9d4f-acee2f20216e req-d246c3ab-9076-4412-8234-d4e2357c0dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a", "name": "network-vif-plugged", "status": "completed", "tag": "f1ec22c6-261a-4c67-84d2-31f8a47e0693"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:51:58.494204 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-65bbc657-c315-4556-9d4f-acee2f20216e req-d246c3ab-9076-4412-8234-d4e2357c0dbf service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:58.495147 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-65bbc657-c315-4556-9d4f-acee2f20216e req-d246c3ab-9076-4412-8234-d4e2357c0dbf service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:58.495390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-65bbc657-c315-4556-9d4f-acee2f20216e req-d246c3ab-9076-4412-8234-d4e2357c0dbf service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:58.506028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:58.508743 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-65bbc657-c315-4556-9d4f-acee2f20216e req-d246c3ab-9076-4412-8234-d4e2357c0dbf service nova] Creating event network-vif-plugged:f1ec22c6-261a-4c67-84d2-31f8a47e0693 for instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a on hv-cinder-85427 Aug 29 23:51:58.514730 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-65bbc657-c315-4556-9d4f-acee2f20216e req-d246c3ab-9076-4412-8234-d4e2357c0dbf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.388010 Aug 29 23:51:58.517180 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 62/124] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:51:58.517456 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:58.518630 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:58.520457 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-bc668c46-1448-4e9e-ab50-a803993ab637 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.246629 Aug 29 23:51:58.521323 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 63/125] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:58 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:51:58.522904 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1cd64acb-5187-4051-9f89-6706a648b209 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:58.523587 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1cd64acb-5187-4051-9f89-6706a648b209 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:58.530128 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1cd64acb-5187-4051-9f89-6706a648b209 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:58.530637 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1cd64acb-5187-4051-9f89-6706a648b209 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:58.531064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1cd64acb-5187-4051-9f89-6706a648b209 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:58.531794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1cd64acb-5187-4051-9f89-6706a648b209 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:58.532239 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1cd64acb-5187-4051-9f89-6706a648b209 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:58.532652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1cd64acb-5187-4051-9f89-6706a648b209 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:58.621054 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-86570676-aecf-4aa7-990e-00759e7c61a4 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:58.622148 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-86570676-aecf-4aa7-990e-00759e7c61a4 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:58.638085 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-86570676-aecf-4aa7-990e-00759e7c61a4 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:58.639291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-86570676-aecf-4aa7-990e-00759e7c61a4 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:58.643530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-86570676-aecf-4aa7-990e-00759e7c61a4 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:58.645756 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-86570676-aecf-4aa7-990e-00759e7c61a4 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:58.647949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-86570676-aecf-4aa7-990e-00759e7c61a4 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:58.648810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-86570676-aecf-4aa7-990e-00759e7c61a4 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:58.693646 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:58.703158 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1cd64acb-5187-4051-9f89-6706a648b209 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:58.718979 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1cd64acb-5187-4051-9f89-6706a648b209 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.201430 Aug 29 23:51:58.734714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 63/126] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:58 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:58.847020 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-86570676-aecf-4aa7-990e-00759e7c61a4 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:58.858450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-86570676-aecf-4aa7-990e-00759e7c61a4 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.245224 Aug 29 23:51:58.862623 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 64/127] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:58 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:59.133395 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f595b637-ead9-46d0-a175-d1399e258328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:59.138785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f595b637-ead9-46d0-a175-d1399e258328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:59.152877 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f595b637-ead9-46d0-a175-d1399e258328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:59.154487 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f595b637-ead9-46d0-a175-d1399e258328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:59.155119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f595b637-ead9-46d0-a175-d1399e258328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:59.158026 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f595b637-ead9-46d0-a175-d1399e258328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:59.158668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f595b637-ead9-46d0-a175-d1399e258328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:59.162248 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f595b637-ead9-46d0-a175-d1399e258328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:59.184871 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-05f7bc38-3173-4f3b-8936-4fea19388d63 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:59.185567 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-05f7bc38-3173-4f3b-8936-4fea19388d63 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:59.193515 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05f7bc38-3173-4f3b-8936-4fea19388d63 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:59.194009 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05f7bc38-3173-4f3b-8936-4fea19388d63 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:59.194466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05f7bc38-3173-4f3b-8936-4fea19388d63 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:59.195678 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05f7bc38-3173-4f3b-8936-4fea19388d63 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:59.196270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05f7bc38-3173-4f3b-8936-4fea19388d63 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:59.196850 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05f7bc38-3173-4f3b-8936-4fea19388d63 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:59.688085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f595b637-ead9-46d0-a175-d1399e258328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:59.702555 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f595b637-ead9-46d0-a175-d1399e258328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.570985 Aug 29 23:51:59.703828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 64/128] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:59 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:51:59.712675 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:59.717531 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:59.732493 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:59.736550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:59.737236 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:59.737768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:59.739229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:59.739811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:59.740338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:59.756930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-05f7bc38-3173-4f3b-8936-4fea19388d63 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:51:59.770803 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-05f7bc38-3173-4f3b-8936-4fea19388d63 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.591868 Aug 29 23:51:59.771581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 65/129] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:59 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:51:59.784571 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dc4077d1-596f-4fef-9d59-00250cac7df0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:51:59.789673 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-dc4077d1-596f-4fef-9d59-00250cac7df0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:51:59.796216 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc4077d1-596f-4fef-9d59-00250cac7df0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:59.807520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc4077d1-596f-4fef-9d59-00250cac7df0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:59.808269 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc4077d1-596f-4fef-9d59-00250cac7df0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:51:59.809191 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc4077d1-596f-4fef-9d59-00250cac7df0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:51:59.809826 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc4077d1-596f-4fef-9d59-00250cac7df0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:51:59.810481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc4077d1-596f-4fef-9d59-00250cac7df0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:00.447709 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-dc4077d1-596f-4fef-9d59-00250cac7df0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:00.454381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:00.459992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-dc4077d1-596f-4fef-9d59-00250cac7df0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.686964 Aug 29 23:52:00.460854 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 66/130] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:51:59 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:00.476695 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:00.479581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8aee25fc-1f90-4bd9-9665-bc09dbfc127c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:00.480197 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:00.480921 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8aee25fc-1f90-4bd9-9665-bc09dbfc127c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:00.481952 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6fce122e-4fe6-4636-b6a5-eef07645ebf1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.776248 Aug 29 23:52:00.482927 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 65/131] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:51:59 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:00.493182 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aee25fc-1f90-4bd9-9665-bc09dbfc127c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:00.497428 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aee25fc-1f90-4bd9-9665-bc09dbfc127c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:00.497428 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aee25fc-1f90-4bd9-9665-bc09dbfc127c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:00.498879 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aee25fc-1f90-4bd9-9665-bc09dbfc127c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:00.500107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aee25fc-1f90-4bd9-9665-bc09dbfc127c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:00.501067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aee25fc-1f90-4bd9-9665-bc09dbfc127c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:00.551662 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-0261648a-fb1b-4130-9459-870ce89354a9 req-37d6996d-1b88-4662-b8f3-44c2921632d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d83695-337c-4680-ac86-9e9aa83f52f0", "name": "network-vif-plugged", "status": "completed", "tag": "a3bc2dbb-5f57-4183-b6af-6edb5fc60c9c"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:00.570586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-0261648a-fb1b-4130-9459-870ce89354a9 req-37d6996d-1b88-4662-b8f3-44c2921632d2 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:00.571601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-0261648a-fb1b-4130-9459-870ce89354a9 req-37d6996d-1b88-4662-b8f3-44c2921632d2 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:00.571821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-0261648a-fb1b-4130-9459-870ce89354a9 req-37d6996d-1b88-4662-b8f3-44c2921632d2 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:00.588912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-0261648a-fb1b-4130-9459-870ce89354a9 req-37d6996d-1b88-4662-b8f3-44c2921632d2 service nova] Creating event network-vif-plugged:a3bc2dbb-5f57-4183-b6af-6edb5fc60c9c for instance e5d83695-337c-4680-ac86-9e9aa83f52f0 on hv-cinder-85427 Aug 29 23:52:00.596304 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-0261648a-fb1b-4130-9459-870ce89354a9 req-37d6996d-1b88-4662-b8f3-44c2921632d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051005 Aug 29 23:52:00.597444 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 66/132] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:00.693931 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8aee25fc-1f90-4bd9-9665-bc09dbfc127c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:00.705024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8aee25fc-1f90-4bd9-9665-bc09dbfc127c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.243076 Aug 29 23:52:00.705617 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 67/133] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:00 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:00.731791 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f9b39905-9935-4032-a294-3a16a5076e60 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:00.733004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f9b39905-9935-4032-a294-3a16a5076e60 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:00.748120 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9b39905-9935-4032-a294-3a16a5076e60 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:00.756910 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9b39905-9935-4032-a294-3a16a5076e60 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:00.757355 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9b39905-9935-4032-a294-3a16a5076e60 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:00.764084 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9b39905-9935-4032-a294-3a16a5076e60 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:00.764084 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9b39905-9935-4032-a294-3a16a5076e60 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:00.764084 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9b39905-9935-4032-a294-3a16a5076e60 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:00.764834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:00.796493 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-193428d1-d95c-47a8-b763-cb662acbcc52 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:00.797106 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-193428d1-d95c-47a8-b763-cb662acbcc52 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:00.805344 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-193428d1-d95c-47a8-b763-cb662acbcc52 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:00.805832 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-193428d1-d95c-47a8-b763-cb662acbcc52 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:00.807638 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-193428d1-d95c-47a8-b763-cb662acbcc52 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:00.811988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-193428d1-d95c-47a8-b763-cb662acbcc52 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:00.812675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-193428d1-d95c-47a8-b763-cb662acbcc52 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:00.815278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-193428d1-d95c-47a8-b763-cb662acbcc52 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:00.984469 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f9b39905-9935-4032-a294-3a16a5076e60 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:00.998834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f9b39905-9935-4032-a294-3a16a5076e60 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.273981 Aug 29 23:52:00.999682 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 67/134] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:00 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:01.101115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-193428d1-d95c-47a8-b763-cb662acbcc52 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:01.113628 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-193428d1-d95c-47a8-b763-cb662acbcc52 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.320248 Aug 29 23:52:01.126559 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 68/135] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:00 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:01.488865 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-710f5a62-5e05-42dc-b44f-fbc804b9b997 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:01.491829 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-710f5a62-5e05-42dc-b44f-fbc804b9b997 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:01.506149 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:01.510116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:01.520563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:01.527648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:01.531316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:01.531316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:01.531316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:01.531316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:01.539249 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-710f5a62-5e05-42dc-b44f-fbc804b9b997 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:01.540193 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-710f5a62-5e05-42dc-b44f-fbc804b9b997 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:01.540965 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-710f5a62-5e05-42dc-b44f-fbc804b9b997 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:01.553529 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-710f5a62-5e05-42dc-b44f-fbc804b9b997 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:01.554457 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-710f5a62-5e05-42dc-b44f-fbc804b9b997 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:01.556352 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-710f5a62-5e05-42dc-b44f-fbc804b9b997 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:02.048978 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:02.062168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-710f5a62-5e05-42dc-b44f-fbc804b9b997 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:02.080933 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:02.084002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:02.086126 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-89ae46ec-0dc4-4254-8ef7-fc37d7699316 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.584472 Aug 29 23:52:02.089989 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-710f5a62-5e05-42dc-b44f-fbc804b9b997 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.609333 Aug 29 23:52:02.092359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 68/136] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:01 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:02.095593 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 69/137] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:01 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:52:02.119575 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ae3f5e7d-000b-4ddd-a493-61b48c8848ff tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:02.120881 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ae3f5e7d-000b-4ddd-a493-61b48c8848ff tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:02.141290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae3f5e7d-000b-4ddd-a493-61b48c8848ff tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:02.142537 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae3f5e7d-000b-4ddd-a493-61b48c8848ff tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:02.143562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae3f5e7d-000b-4ddd-a493-61b48c8848ff tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:02.144286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e24feaff-807c-4dd1-93d8-155df122b680 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:02.145511 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e24feaff-807c-4dd1-93d8-155df122b680 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:02.146776 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae3f5e7d-000b-4ddd-a493-61b48c8848ff tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:02.147893 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae3f5e7d-000b-4ddd-a493-61b48c8848ff tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:02.149094 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae3f5e7d-000b-4ddd-a493-61b48c8848ff tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:02.160929 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e24feaff-807c-4dd1-93d8-155df122b680 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:02.161518 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e24feaff-807c-4dd1-93d8-155df122b680 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:02.162016 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e24feaff-807c-4dd1-93d8-155df122b680 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:02.162860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e24feaff-807c-4dd1-93d8-155df122b680 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:02.163376 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e24feaff-807c-4dd1-93d8-155df122b680 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:02.163904 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e24feaff-807c-4dd1-93d8-155df122b680 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:02.552041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ae3f5e7d-000b-4ddd-a493-61b48c8848ff tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:02.558733 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e24feaff-807c-4dd1-93d8-155df122b680 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:02.563914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ae3f5e7d-000b-4ddd-a493-61b48c8848ff tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.466553 Aug 29 23:52:02.564818 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 70/138] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:02 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:02.571127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a0014431-9cc2-4239-96b0-6d88a90b85e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:02.571901 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a0014431-9cc2-4239-96b0-6d88a90b85e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:02.572002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e24feaff-807c-4dd1-93d8-155df122b680 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.477971 Aug 29 23:52:02.572766 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 69/139] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:02 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:02.579368 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0014431-9cc2-4239-96b0-6d88a90b85e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:02.580145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0014431-9cc2-4239-96b0-6d88a90b85e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:02.580719 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0014431-9cc2-4239-96b0-6d88a90b85e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:02.582187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0014431-9cc2-4239-96b0-6d88a90b85e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:02.583378 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0014431-9cc2-4239-96b0-6d88a90b85e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:02.583959 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0014431-9cc2-4239-96b0-6d88a90b85e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:02.624241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-2b070a2a-31a7-4df3-ae2a-95b65cf5ebc7 req-e9633ec0-cc7c-430d-8430-a18cb32c5ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ec8e13-8f80-45fd-a17c-02fdc4737427", "name": "network-vif-plugged", "status": "completed", "tag": "f40880ff-7fed-43ae-a195-d6745bc86dde"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:02.640351 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-2b070a2a-31a7-4df3-ae2a-95b65cf5ebc7 req-e9633ec0-cc7c-430d-8430-a18cb32c5ea9 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:02.641557 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-2b070a2a-31a7-4df3-ae2a-95b65cf5ebc7 req-e9633ec0-cc7c-430d-8430-a18cb32c5ea9 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:02.642677 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-2b070a2a-31a7-4df3-ae2a-95b65cf5ebc7 req-e9633ec0-cc7c-430d-8430-a18cb32c5ea9 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:02.666012 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-2b070a2a-31a7-4df3-ae2a-95b65cf5ebc7 req-e9633ec0-cc7c-430d-8430-a18cb32c5ea9 service nova] Creating event network-vif-plugged:f40880ff-7fed-43ae-a195-d6745bc86dde for instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 on hv-cinder-85427 Aug 29 23:52:02.672506 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-2b070a2a-31a7-4df3-ae2a-95b65cf5ebc7 req-e9633ec0-cc7c-430d-8430-a18cb32c5ea9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052834 Aug 29 23:52:02.673264 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 70/140] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:02.777141 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:02.832118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a0014431-9cc2-4239-96b0-6d88a90b85e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:02.849111 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a0014431-9cc2-4239-96b0-6d88a90b85e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1363 microversion: 2.1 time: 0.282868 Aug 29 23:52:02.850542 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 71/141] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:02 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:03.129453 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-60de2779-470c-43fe-bd37-19c9f3fd94a0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:03.130407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-60de2779-470c-43fe-bd37-19c9f3fd94a0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:03.134061 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:03.150293 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60de2779-470c-43fe-bd37-19c9f3fd94a0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:03.150293 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60de2779-470c-43fe-bd37-19c9f3fd94a0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:03.150293 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60de2779-470c-43fe-bd37-19c9f3fd94a0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:03.150764 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:03.150764 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:03.152169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:03.153272 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60de2779-470c-43fe-bd37-19c9f3fd94a0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:03.153985 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60de2779-470c-43fe-bd37-19c9f3fd94a0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:03.155166 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60de2779-470c-43fe-bd37-19c9f3fd94a0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:03.156024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:03.156689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:03.157109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:03.157811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:03.158243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:03.158872 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:03.493497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:03.554385 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:03.555478 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:03.556756 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-60a6ba8e-a774-40f0-96da-3906003f9c6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.414220 Aug 29 23:52:03.557294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 72/142] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:03 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:52:03.560359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-60de2779-470c-43fe-bd37-19c9f3fd94a0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:03.588013 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-60de2779-470c-43fe-bd37-19c9f3fd94a0 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1321 microversion: 2.1 time: 0.464111 Aug 29 23:52:03.592588 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 71/143] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:03 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:03.607461 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-912e779c-934b-40ef-8eb9-0d515888750e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:03.608847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-912e779c-934b-40ef-8eb9-0d515888750e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:03.616405 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f60d7909-5644-469b-a6d4-14d91cf120de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:03.617095 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f60d7909-5644-469b-a6d4-14d91cf120de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:03.617943 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-912e779c-934b-40ef-8eb9-0d515888750e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:03.618713 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-912e779c-934b-40ef-8eb9-0d515888750e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:03.619432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-912e779c-934b-40ef-8eb9-0d515888750e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:03.620365 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-912e779c-934b-40ef-8eb9-0d515888750e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:03.621026 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-912e779c-934b-40ef-8eb9-0d515888750e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:03.621677 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-912e779c-934b-40ef-8eb9-0d515888750e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:03.625125 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f60d7909-5644-469b-a6d4-14d91cf120de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:03.625674 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f60d7909-5644-469b-a6d4-14d91cf120de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:03.626169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f60d7909-5644-469b-a6d4-14d91cf120de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:03.626978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f60d7909-5644-469b-a6d4-14d91cf120de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:03.627491 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f60d7909-5644-469b-a6d4-14d91cf120de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:03.627978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f60d7909-5644-469b-a6d4-14d91cf120de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:04.022749 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-912e779c-934b-40ef-8eb9-0d515888750e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:04.032955 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-912e779c-934b-40ef-8eb9-0d515888750e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.438862 Aug 29 23:52:04.035377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 73/144] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:03 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:04.042635 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-60337d5c-5c5c-44aa-bd90-83cd22467c8e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:04.043406 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-60337d5c-5c5c-44aa-bd90-83cd22467c8e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:04.045614 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f60d7909-5644-469b-a6d4-14d91cf120de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:04.050179 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60337d5c-5c5c-44aa-bd90-83cd22467c8e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:04.059435 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f60d7909-5644-469b-a6d4-14d91cf120de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.447155 Aug 29 23:52:04.060633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60337d5c-5c5c-44aa-bd90-83cd22467c8e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:04.061685 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 72/145] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:03 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:04.068680 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60337d5c-5c5c-44aa-bd90-83cd22467c8e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:04.070782 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60337d5c-5c5c-44aa-bd90-83cd22467c8e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:04.075089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60337d5c-5c5c-44aa-bd90-83cd22467c8e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:04.075668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-60337d5c-5c5c-44aa-bd90-83cd22467c8e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:04.265644 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-60337d5c-5c5c-44aa-bd90-83cd22467c8e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:04.274448 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-60337d5c-5c5c-44aa-bd90-83cd22467c8e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1549 microversion: 2.1 time: 0.239693 Aug 29 23:52:04.278225 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 74/146] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:04 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1549 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:04.296263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9c7a5686-c8b3-4f3d-821b-50dacfe34cac tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:04.296862 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9c7a5686-c8b3-4f3d-821b-50dacfe34cac tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:04.304159 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c7a5686-c8b3-4f3d-821b-50dacfe34cac tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:04.304824 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c7a5686-c8b3-4f3d-821b-50dacfe34cac tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:04.305254 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c7a5686-c8b3-4f3d-821b-50dacfe34cac tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:04.305947 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c7a5686-c8b3-4f3d-821b-50dacfe34cac tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:04.306747 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c7a5686-c8b3-4f3d-821b-50dacfe34cac tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:04.306844 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c7a5686-c8b3-4f3d-821b-50dacfe34cac tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:04.441918 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9c7a5686-c8b3-4f3d-821b-50dacfe34cac tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149800 Aug 29 23:52:04.445240 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 73/147] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Aug 29 23:52:04 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:04.617410 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:04.618343 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:04.634372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:04.639162 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:04.639612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:04.640355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:04.640813 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:04.641242 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:04.648705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a97564a8-60be-4a04-9fcc-5eff5446e704 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:04.650860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a97564a8-60be-4a04-9fcc-5eff5446e704 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:04.694795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a97564a8-60be-4a04-9fcc-5eff5446e704 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:04.695520 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a97564a8-60be-4a04-9fcc-5eff5446e704 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:04.709091 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a97564a8-60be-4a04-9fcc-5eff5446e704 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:04.710495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a97564a8-60be-4a04-9fcc-5eff5446e704 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:04.710959 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a97564a8-60be-4a04-9fcc-5eff5446e704 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:04.711553 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a97564a8-60be-4a04-9fcc-5eff5446e704 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:05.026278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:05.043132 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:05.044641 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:05.046371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8751caa3-637e-47b2-a108-4f4c0916b46c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.439270 Aug 29 23:52:05.071398 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 75/148] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:04 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:05.071398 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e5cc230a-07f1-44bd-8e79-94416808b91d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:05.071398 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e5cc230a-07f1-44bd-8e79-94416808b91d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:05.108059 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e5cc230a-07f1-44bd-8e79-94416808b91d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:05.108560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e5cc230a-07f1-44bd-8e79-94416808b91d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:05.109011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e5cc230a-07f1-44bd-8e79-94416808b91d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:05.109780 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e5cc230a-07f1-44bd-8e79-94416808b91d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:05.110250 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e5cc230a-07f1-44bd-8e79-94416808b91d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:05.110712 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e5cc230a-07f1-44bd-8e79-94416808b91d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:05.158121 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a97564a8-60be-4a04-9fcc-5eff5446e704 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:05.171259 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a97564a8-60be-4a04-9fcc-5eff5446e704 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1516 microversion: 2.1 time: 0.545812 Aug 29 23:52:05.171976 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 74/149] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:04 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1516 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:05.178168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c249f3b3-6d91-400a-8bde-220ef74917c4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:05.178842 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c249f3b3-6d91-400a-8bde-220ef74917c4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:05.194169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c249f3b3-6d91-400a-8bde-220ef74917c4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:05.194762 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c249f3b3-6d91-400a-8bde-220ef74917c4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:05.195349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c249f3b3-6d91-400a-8bde-220ef74917c4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:05.196336 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c249f3b3-6d91-400a-8bde-220ef74917c4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:05.196846 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c249f3b3-6d91-400a-8bde-220ef74917c4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:05.197278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c249f3b3-6d91-400a-8bde-220ef74917c4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:05.482160 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e5cc230a-07f1-44bd-8e79-94416808b91d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:05.499480 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e5cc230a-07f1-44bd-8e79-94416808b91d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1315 microversion: 2.1 time: 0.438628 Aug 29 23:52:05.507288 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 76/150] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:05 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:05.525922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f3a9b4b0-fd01-43cf-87e4-d55f2499eaf6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:05.527866 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c249f3b3-6d91-400a-8bde-220ef74917c4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:05.534785 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f3a9b4b0-fd01-43cf-87e4-d55f2499eaf6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:05.538290 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c249f3b3-6d91-400a-8bde-220ef74917c4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.365125 Aug 29 23:52:05.538928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 75/151] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:05 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:05.542503 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3a9b4b0-fd01-43cf-87e4-d55f2499eaf6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:05.543412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3a9b4b0-fd01-43cf-87e4-d55f2499eaf6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:05.543866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3a9b4b0-fd01-43cf-87e4-d55f2499eaf6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:05.544782 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3a9b4b0-fd01-43cf-87e4-d55f2499eaf6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:05.545226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3a9b4b0-fd01-43cf-87e4-d55f2499eaf6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:05.545673 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f3a9b4b0-fd01-43cf-87e4-d55f2499eaf6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:05.634634 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-f3a9b4b0-fd01-43cf-87e4-d55f2499eaf6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lazy-loading 'flavor' on Instance uuid e5d83695-337c-4680-ac86-9e9aa83f52f0 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:52:06.043395 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f3a9b4b0-fd01-43cf-87e4-d55f2499eaf6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0/action" status: 200 len: 32 microversion: 2.1 time: 0.531908 Aug 29 23:52:06.044228 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 77/152] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:52:05 2022] POST /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0/action => generated 32 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:52:06.058828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-bc0b6c85-31c3-4009-86e9-dc6e9a296703 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:06.059533 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-bc0b6c85-31c3-4009-86e9-dc6e9a296703 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:06.071404 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc0b6c85-31c3-4009-86e9-dc6e9a296703 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:06.072466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc0b6c85-31c3-4009-86e9-dc6e9a296703 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:06.073393 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc0b6c85-31c3-4009-86e9-dc6e9a296703 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:06.074721 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc0b6c85-31c3-4009-86e9-dc6e9a296703 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:06.075402 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc0b6c85-31c3-4009-86e9-dc6e9a296703 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:06.076324 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc0b6c85-31c3-4009-86e9-dc6e9a296703 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:06.113383 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:06.126791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:06.163911 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:06.164419 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:06.166261 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:06.170233 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:06.171101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:06.171670 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:06.399296 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bc0b6c85-31c3-4009-86e9-dc6e9a296703 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:06.424314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-bc0b6c85-31c3-4009-86e9-dc6e9a296703 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.370049 Aug 29 23:52:06.439652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 76/153] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:06 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:06.439979 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:06.453309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:06.455512 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:06.457132 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4a38892e-62cb-414f-92ef-fe772d20a564 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.359057 Aug 29 23:52:06.457800 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 78/154] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:06 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:06.527531 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a1624ec9-5d23-4a47-9392-7d50df402405 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:06.528143 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a1624ec9-5d23-4a47-9392-7d50df402405 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:06.536168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1624ec9-5d23-4a47-9392-7d50df402405 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:06.536653 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1624ec9-5d23-4a47-9392-7d50df402405 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:06.537478 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1624ec9-5d23-4a47-9392-7d50df402405 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:06.538625 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1624ec9-5d23-4a47-9392-7d50df402405 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:06.542848 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1624ec9-5d23-4a47-9392-7d50df402405 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:06.542848 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1624ec9-5d23-4a47-9392-7d50df402405 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:06.570817 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4c2e18eb-1d87-4316-b4c1-9491b535f0d2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:06.571678 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4c2e18eb-1d87-4316-b4c1-9491b535f0d2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:06.580034 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c2e18eb-1d87-4316-b4c1-9491b535f0d2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:06.580948 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c2e18eb-1d87-4316-b4c1-9491b535f0d2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:06.581718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c2e18eb-1d87-4316-b4c1-9491b535f0d2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:06.582821 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c2e18eb-1d87-4316-b4c1-9491b535f0d2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:06.588994 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c2e18eb-1d87-4316-b4c1-9491b535f0d2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:06.588994 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c2e18eb-1d87-4316-b4c1-9491b535f0d2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:06.607094 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:06.741129 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a1624ec9-5d23-4a47-9392-7d50df402405 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:06.751515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a1624ec9-5d23-4a47-9392-7d50df402405 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1501 microversion: 2.1 time: 0.228105 Aug 29 23:52:06.752099 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 77/155] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:06 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1501 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:06.766559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-e4c08eed-cd6b-4222-a387-563a38d415a3 req-0e5b9db2-da8e-4d27-b468-31109a0b2184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a", "tag": "f1ec22c6-261a-4c67-84d2-31f8a47e0693"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:06.787131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-e4c08eed-cd6b-4222-a387-563a38d415a3 req-0e5b9db2-da8e-4d27-b468-31109a0b2184 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:06.787611 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-e4c08eed-cd6b-4222-a387-563a38d415a3 req-0e5b9db2-da8e-4d27-b468-31109a0b2184 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:06.789159 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-e4c08eed-cd6b-4222-a387-563a38d415a3 req-0e5b9db2-da8e-4d27-b468-31109a0b2184 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:06.806714 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4c2e18eb-1d87-4316-b4c1-9491b535f0d2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:06.810360 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-e4c08eed-cd6b-4222-a387-563a38d415a3 req-0e5b9db2-da8e-4d27-b468-31109a0b2184 service nova] Creating event network-changed:f1ec22c6-261a-4c67-84d2-31f8a47e0693 for instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a on hv-cinder-85427 Aug 29 23:52:06.821401 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4c2e18eb-1d87-4316-b4c1-9491b535f0d2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.252593 Aug 29 23:52:06.821401 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 79/156] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:06 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:06.821566 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-e4c08eed-cd6b-4222-a387-563a38d415a3 req-0e5b9db2-da8e-4d27-b468-31109a0b2184 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064306 Aug 29 23:52:06.822621 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 78/157] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:07.448463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-aa9cc3fc-2e7d-4b22-b746-353b828b61c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:07.449879 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-aa9cc3fc-2e7d-4b22-b746-353b828b61c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:07.456905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa9cc3fc-2e7d-4b22-b746-353b828b61c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:07.457824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa9cc3fc-2e7d-4b22-b746-353b828b61c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:07.458519 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa9cc3fc-2e7d-4b22-b746-353b828b61c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:07.459451 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa9cc3fc-2e7d-4b22-b746-353b828b61c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:07.460273 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa9cc3fc-2e7d-4b22-b746-353b828b61c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:07.460895 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa9cc3fc-2e7d-4b22-b746-353b828b61c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:07.499204 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:07.503792 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:07.522878 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:07.523803 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:07.525651 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:07.529246 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:07.530966 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:07.532201 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:07.698274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-aa9cc3fc-2e7d-4b22-b746-353b828b61c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:07.711965 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-aa9cc3fc-2e7d-4b22-b746-353b828b61c1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.267330 Aug 29 23:52:07.725861 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 80/158] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:07 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:07.761568 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:07.773260 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:07.774919 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:07.776842 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-bb1ba8c5-93a7-4724-a530-480d74bfceab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.291525 Aug 29 23:52:07.788566 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 79/159] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:07 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:07.841346 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-70836c18-055b-44c1-b7e2-b679ace1dafe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:07.841865 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-70836c18-055b-44c1-b7e2-b679ace1dafe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:07.848958 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70836c18-055b-44c1-b7e2-b679ace1dafe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:07.849499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70836c18-055b-44c1-b7e2-b679ace1dafe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:07.850187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70836c18-055b-44c1-b7e2-b679ace1dafe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:07.850921 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70836c18-055b-44c1-b7e2-b679ace1dafe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:07.851583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70836c18-055b-44c1-b7e2-b679ace1dafe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:07.852182 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70836c18-055b-44c1-b7e2-b679ace1dafe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:08.020705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-70836c18-055b-44c1-b7e2-b679ace1dafe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:08.036987 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-70836c18-055b-44c1-b7e2-b679ace1dafe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.199100 Aug 29 23:52:08.038041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 81/160] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:07 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:08.736551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d241a6b2-87f8-41d4-a3e1-75d40d6775fc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:08.738515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d241a6b2-87f8-41d4-a3e1-75d40d6775fc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:08.744908 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d241a6b2-87f8-41d4-a3e1-75d40d6775fc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:08.745460 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d241a6b2-87f8-41d4-a3e1-75d40d6775fc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:08.746005 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d241a6b2-87f8-41d4-a3e1-75d40d6775fc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:08.746822 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d241a6b2-87f8-41d4-a3e1-75d40d6775fc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:08.747331 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d241a6b2-87f8-41d4-a3e1-75d40d6775fc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:08.747755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d241a6b2-87f8-41d4-a3e1-75d40d6775fc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:08.804876 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:08.806298 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:08.825139 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:08.825651 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:08.826864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:08.827009 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:08.827439 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:08.833166 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:09.411679 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d241a6b2-87f8-41d4-a3e1-75d40d6775fc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:09.428439 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d241a6b2-87f8-41d4-a3e1-75d40d6775fc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.695964 Aug 29 23:52:09.429955 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 80/161] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:08 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:09.439061 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f9bdfeb8-c18b-4f03-8087-2386810abcaf tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:09.445067 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f9bdfeb8-c18b-4f03-8087-2386810abcaf tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:09.460154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9bdfeb8-c18b-4f03-8087-2386810abcaf tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:09.460729 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9bdfeb8-c18b-4f03-8087-2386810abcaf tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:09.462405 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9bdfeb8-c18b-4f03-8087-2386810abcaf tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:09.463556 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9bdfeb8-c18b-4f03-8087-2386810abcaf tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:09.464049 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9bdfeb8-c18b-4f03-8087-2386810abcaf tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:09.465493 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9bdfeb8-c18b-4f03-8087-2386810abcaf tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:09.561128 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:09.563945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:09.565707 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:09.583259 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9269bbf1-200b-402a-abdf-53c3b8b90e08 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.785432 Aug 29 23:52:09.584446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 82/162] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:08 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:09.782849 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ae1c3357-93d4-458e-ab01-a4474b75f40d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7066e492-95cf-4581-87f5-e5d4e5ab0b5b"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:09.786037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ae1c3357-93d4-458e-ab01-a4474b75f40d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:09.795764 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae1c3357-93d4-458e-ab01-a4474b75f40d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:09.796761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae1c3357-93d4-458e-ab01-a4474b75f40d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:09.797747 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae1c3357-93d4-458e-ab01-a4474b75f40d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:09.798816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae1c3357-93d4-458e-ab01-a4474b75f40d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:09.800216 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae1c3357-93d4-458e-ab01-a4474b75f40d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:09.801320 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae1c3357-93d4-458e-ab01-a4474b75f40d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:09.891458 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f9bdfeb8-c18b-4f03-8087-2386810abcaf tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:09.905681 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f9bdfeb8-c18b-4f03-8087-2386810abcaf tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.474375 Aug 29 23:52:09.906583 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 81/163] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:09 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:09.978112 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-29f60f52-0466-4ee3-abf9-4ba4c5040a98 req-b11463bf-a4dd-41c2-b673-fdb876aed4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32036006-145d-499d-848e-16bd2f8f9abf", "name": "network-vif-plugged", "status": "completed", "tag": "01e67dee-c059-44c0-b274-3278a508338c"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:10.008477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-29f60f52-0466-4ee3-abf9-4ba4c5040a98 req-b11463bf-a4dd-41c2-b673-fdb876aed4dd service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:10.009004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-29f60f52-0466-4ee3-abf9-4ba4c5040a98 req-b11463bf-a4dd-41c2-b673-fdb876aed4dd service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:10.010629 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-29f60f52-0466-4ee3-abf9-4ba4c5040a98 req-b11463bf-a4dd-41c2-b673-fdb876aed4dd service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:10.037375 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-29f60f52-0466-4ee3-abf9-4ba4c5040a98 req-b11463bf-a4dd-41c2-b673-fdb876aed4dd service nova] Creating event network-vif-plugged:01e67dee-c059-44c0-b274-3278a508338c for instance 32036006-145d-499d-848e-16bd2f8f9abf on hv-cinder-85427 Aug 29 23:52:10.063867 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-29f60f52-0466-4ee3-abf9-4ba4c5040a98 req-b11463bf-a4dd-41c2-b673-fdb876aed4dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101864 Aug 29 23:52:10.069096 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 82/164] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:52:10.454835 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-07e8420e-bed8-4bd9-9fac-25b95df25358 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:10.457714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-07e8420e-bed8-4bd9-9fac-25b95df25358 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:10.476425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-07e8420e-bed8-4bd9-9fac-25b95df25358 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:10.477210 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-07e8420e-bed8-4bd9-9fac-25b95df25358 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:10.478004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-07e8420e-bed8-4bd9-9fac-25b95df25358 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:10.478958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-07e8420e-bed8-4bd9-9fac-25b95df25358 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:10.479699 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-07e8420e-bed8-4bd9-9fac-25b95df25358 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:10.480411 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-07e8420e-bed8-4bd9-9fac-25b95df25358 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:11.022342 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-07e8420e-bed8-4bd9-9fac-25b95df25358 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:11.031581 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-07e8420e-bed8-4bd9-9fac-25b95df25358 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.583152 Aug 29 23:52:11.032450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 83/165] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:10 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:11.037871 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:11.038814 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:11.049093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:11.050758 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:11.051564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:11.052768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:11.053568 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:11.054554 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:11.266568 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ae1c3357-93d4-458e-ab01-a4474b75f40d tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "POST /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.491324 Aug 29 23:52:11.275691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 83/166] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:52:09 2022] POST /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427/os-volume_attachments => generated 194 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:52:11.303870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ca46e9bd-61a6-49f6-ba5c-eb7f735b3ba8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:11.304913 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ca46e9bd-61a6-49f6-ba5c-eb7f735b3ba8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:11.337755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ca46e9bd-61a6-49f6-ba5c-eb7f735b3ba8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:11.338540 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ca46e9bd-61a6-49f6-ba5c-eb7f735b3ba8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:11.338990 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ca46e9bd-61a6-49f6-ba5c-eb7f735b3ba8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:11.339727 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ca46e9bd-61a6-49f6-ba5c-eb7f735b3ba8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:11.340187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ca46e9bd-61a6-49f6-ba5c-eb7f735b3ba8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:11.340679 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ca46e9bd-61a6-49f6-ba5c-eb7f735b3ba8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:11.535349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:11.569510 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:11.574848 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:11.583793 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c744a431-5c0d-4321-a819-9b134ccaf41d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.546432 Aug 29 23:52:11.585119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 84/167] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:11 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:11.673554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ca46e9bd-61a6-49f6-ba5c-eb7f735b3ba8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:11.686757 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ca46e9bd-61a6-49f6-ba5c-eb7f735b3ba8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1367 microversion: 2.1 time: 0.409372 Aug 29 23:52:11.688502 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 84/168] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:11 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:12.068809 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-744a34e7-774d-4e0e-a631-b56eb1815919 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:12.071313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-744a34e7-774d-4e0e-a631-b56eb1815919 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:12.090405 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-744a34e7-774d-4e0e-a631-b56eb1815919 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:12.091148 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-2a425071-0736-49ed-9179-ab18900c3be8 req-1d5911ca-5ef4-474d-a7f1-b5d5323da5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edecb793-ad02-4b6f-addc-020ce872a118", "name": "network-vif-plugged", "status": "completed", "tag": "a058a5e2-fffb-402f-99cc-4946054648c3"}, {"server_uuid": "781bf4fc-f6e6-4efc-b757-5888339b6b3c", "name": "network-vif-plugged", "status": "completed", "tag": "70011c53-2246-46a9-9308-734ee213614a"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:12.092941 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-744a34e7-774d-4e0e-a631-b56eb1815919 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:12.101130 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-744a34e7-774d-4e0e-a631-b56eb1815919 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:12.104536 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-744a34e7-774d-4e0e-a631-b56eb1815919 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:12.105661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-744a34e7-774d-4e0e-a631-b56eb1815919 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:12.106811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-744a34e7-774d-4e0e-a631-b56eb1815919 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:12.112383 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2a425071-0736-49ed-9179-ab18900c3be8 req-1d5911ca-5ef4-474d-a7f1-b5d5323da5f8 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:12.113083 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2a425071-0736-49ed-9179-ab18900c3be8 req-1d5911ca-5ef4-474d-a7f1-b5d5323da5f8 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:12.113720 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2a425071-0736-49ed-9179-ab18900c3be8 req-1d5911ca-5ef4-474d-a7f1-b5d5323da5f8 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:12.135785 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-2a425071-0736-49ed-9179-ab18900c3be8 req-1d5911ca-5ef4-474d-a7f1-b5d5323da5f8 service nova] Creating event network-vif-plugged:a058a5e2-fffb-402f-99cc-4946054648c3 for instance edecb793-ad02-4b6f-addc-020ce872a118 on hv-cinder-85427 Aug 29 23:52:12.159570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-2a425071-0736-49ed-9179-ab18900c3be8 req-1d5911ca-5ef4-474d-a7f1-b5d5323da5f8 service nova] Creating event network-vif-plugged:70011c53-2246-46a9-9308-734ee213614a for instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c on hv-cinder-85427 Aug 29 23:52:12.159570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-2a425071-0736-49ed-9179-ab18900c3be8 req-1d5911ca-5ef4-474d-a7f1-b5d5323da5f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057298 Aug 29 23:52:12.159570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 85/169] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:12.292998 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-744a34e7-774d-4e0e-a631-b56eb1815919 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:12.301796 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-744a34e7-774d-4e0e-a631-b56eb1815919 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.250960 Aug 29 23:52:12.302617 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 85/170] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:12 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:12.615848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:12.615848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:12.633261 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:12.633751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:12.642571 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:12.642571 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:12.642571 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:12.642571 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:12.726396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0ea3e5cb-4983-4ebf-9c91-90762e11572f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:12.727591 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0ea3e5cb-4983-4ebf-9c91-90762e11572f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:12.747859 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0ea3e5cb-4983-4ebf-9c91-90762e11572f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:12.749016 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0ea3e5cb-4983-4ebf-9c91-90762e11572f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:12.749654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0ea3e5cb-4983-4ebf-9c91-90762e11572f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:12.757273 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0ea3e5cb-4983-4ebf-9c91-90762e11572f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:12.759624 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0ea3e5cb-4983-4ebf-9c91-90762e11572f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:12.774480 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0ea3e5cb-4983-4ebf-9c91-90762e11572f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:12.792061 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:13.049051 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:13.075480 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:13.082058 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:13.084403 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7f02eb5a-51c4-4e86-badc-b2083d6e1ab6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.475910 Aug 29 23:52:13.088516 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 86/171] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:12 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:52:13.191261 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0ea3e5cb-4983-4ebf-9c91-90762e11572f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:13.207948 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0ea3e5cb-4983-4ebf-9c91-90762e11572f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1557 microversion: 2.1 time: 0.488612 Aug 29 23:52:13.222816 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 86/172] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:12 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1557 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:13.255000 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b1c387ed-6677-4161-8ba5-916ad5de44f8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:13.256512 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b1c387ed-6677-4161-8ba5-916ad5de44f8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:13.269640 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c387ed-6677-4161-8ba5-916ad5de44f8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:13.271197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c387ed-6677-4161-8ba5-916ad5de44f8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:13.272351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c387ed-6677-4161-8ba5-916ad5de44f8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:13.274007 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c387ed-6677-4161-8ba5-916ad5de44f8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:13.275214 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c387ed-6677-4161-8ba5-916ad5de44f8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:13.276248 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c387ed-6677-4161-8ba5-916ad5de44f8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:13.368913 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2d067348-5feb-4805-abd3-9ee0504c4a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:13.369535 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2d067348-5feb-4805-abd3-9ee0504c4a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:13.379638 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d067348-5feb-4805-abd3-9ee0504c4a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:13.380137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d067348-5feb-4805-abd3-9ee0504c4a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:13.380571 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d067348-5feb-4805-abd3-9ee0504c4a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:13.381283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d067348-5feb-4805-abd3-9ee0504c4a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:13.386183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d067348-5feb-4805-abd3-9ee0504c4a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:13.388399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2d067348-5feb-4805-abd3-9ee0504c4a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:13.642376 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b1c387ed-6677-4161-8ba5-916ad5de44f8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.398181 Aug 29 23:52:13.647924 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 87/173] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Aug 29 23:52:13 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-interface => generated 285 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:13.787953 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2d067348-5feb-4805-abd3-9ee0504c4a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:13.802839 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2d067348-5feb-4805-abd3-9ee0504c4a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.466235 Aug 29 23:52:13.815832 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 87/174] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:13 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:14.120897 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:14.122833 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:14.132874 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:14.133413 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:14.134438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:14.135197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:14.135655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:14.136130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:14.453540 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:14.463968 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:14.466173 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:14.467578 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4d8e7e73-5b0a-4b24-9633-b95d5418e5c5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.356021 Aug 29 23:52:14.468157 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 88/175] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:14 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:14.852298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-082e108c-38b8-456c-a5e8-3703026c4e1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:14.853666 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-082e108c-38b8-456c-a5e8-3703026c4e1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:14.867689 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-082e108c-38b8-456c-a5e8-3703026c4e1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:14.868917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-082e108c-38b8-456c-a5e8-3703026c4e1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:14.869819 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-082e108c-38b8-456c-a5e8-3703026c4e1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:14.871450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-082e108c-38b8-456c-a5e8-3703026c4e1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:14.872425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-082e108c-38b8-456c-a5e8-3703026c4e1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:14.873879 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-082e108c-38b8-456c-a5e8-3703026c4e1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:15.092259 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-082e108c-38b8-456c-a5e8-3703026c4e1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:15.114073 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-082e108c-38b8-456c-a5e8-3703026c4e1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.270838 Aug 29 23:52:15.115553 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 88/176] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:14 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:15.406998 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-ae3be4cf-2c1b-491b-9ff4-9e5cfec6f456 req-c8fc0c79-8c37-4ed2-9c29-ab2568bfba57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32036006-145d-499d-848e-16bd2f8f9abf", "tag": "01e67dee-c059-44c0-b274-3278a508338c"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:15.424581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-ae3be4cf-2c1b-491b-9ff4-9e5cfec6f456 req-c8fc0c79-8c37-4ed2-9c29-ab2568bfba57 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:15.425436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-ae3be4cf-2c1b-491b-9ff4-9e5cfec6f456 req-c8fc0c79-8c37-4ed2-9c29-ab2568bfba57 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:15.426389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-ae3be4cf-2c1b-491b-9ff4-9e5cfec6f456 req-c8fc0c79-8c37-4ed2-9c29-ab2568bfba57 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:15.449481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-ae3be4cf-2c1b-491b-9ff4-9e5cfec6f456 req-c8fc0c79-8c37-4ed2-9c29-ab2568bfba57 service nova] Creating event network-changed:01e67dee-c059-44c0-b274-3278a508338c for instance 32036006-145d-499d-848e-16bd2f8f9abf on hv-cinder-85427 Aug 29 23:52:15.462758 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-ae3be4cf-2c1b-491b-9ff4-9e5cfec6f456 req-c8fc0c79-8c37-4ed2-9c29-ab2568bfba57 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060003 Aug 29 23:52:15.464222 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 89/177] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:15.520943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:15.522378 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:15.536170 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:15.537579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:15.538905 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:15.540513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:15.541724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:15.542992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:15.834071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:15.859258 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:15.864887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:15.867576 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9a5fd39f-e4c8-495b-bd41-d0176b2daeeb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1406 microversion: 2.20 time: 0.354374 Aug 29 23:52:15.868763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 89/178] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:15 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:16.153637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-58ace2bb-9f6f-4a56-abe5-a1879a2b53fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:16.156327 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-58ace2bb-9f6f-4a56-abe5-a1879a2b53fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:16.175223 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58ace2bb-9f6f-4a56-abe5-a1879a2b53fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:16.176604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58ace2bb-9f6f-4a56-abe5-a1879a2b53fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:16.180441 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58ace2bb-9f6f-4a56-abe5-a1879a2b53fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:16.180441 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58ace2bb-9f6f-4a56-abe5-a1879a2b53fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:16.180441 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58ace2bb-9f6f-4a56-abe5-a1879a2b53fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:16.180441 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-58ace2bb-9f6f-4a56-abe5-a1879a2b53fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:16.544570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-58ace2bb-9f6f-4a56-abe5-a1879a2b53fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:16.575157 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-58ace2bb-9f6f-4a56-abe5-a1879a2b53fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.425363 Aug 29 23:52:16.578946 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 90/179] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:16 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:16.907283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:16.913663 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:16.946189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:16.949572 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:16.951441 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:16.954508 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:16.957355 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:16.961441 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:17.489959 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:17.505988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:17.507958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:17.509421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0bb2b1d4-65a9-4ec3-99cc-e555433cb3c4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1598 microversion: 2.20 time: 0.612208 Aug 29 23:52:17.510542 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 90/180] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:52:16 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1598 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:52:17.563885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c95b4d11-fb19-491a-bc71-6e259dd65fdb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:17.565565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c95b4d11-fb19-491a-bc71-6e259dd65fdb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:17.581688 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c95b4d11-fb19-491a-bc71-6e259dd65fdb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:17.582824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c95b4d11-fb19-491a-bc71-6e259dd65fdb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:17.583870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c95b4d11-fb19-491a-bc71-6e259dd65fdb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:17.585909 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c95b4d11-fb19-491a-bc71-6e259dd65fdb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:17.587472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c95b4d11-fb19-491a-bc71-6e259dd65fdb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:17.588510 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c95b4d11-fb19-491a-bc71-6e259dd65fdb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:17.604906 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-39b2838d-1731-4dfa-9c64-e1535b9e98a9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:17.605977 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-39b2838d-1731-4dfa-9c64-e1535b9e98a9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:17.628339 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39b2838d-1731-4dfa-9c64-e1535b9e98a9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:17.629343 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39b2838d-1731-4dfa-9c64-e1535b9e98a9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:17.631216 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39b2838d-1731-4dfa-9c64-e1535b9e98a9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:17.632422 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39b2838d-1731-4dfa-9c64-e1535b9e98a9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:17.633349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39b2838d-1731-4dfa-9c64-e1535b9e98a9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:17.634456 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39b2838d-1731-4dfa-9c64-e1535b9e98a9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:17.841271 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c95b4d11-fb19-491a-bc71-6e259dd65fdb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.288321 Aug 29 23:52:17.842363 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 91/181] 10.222.0.58 () {60 vars in 1316 bytes} [Mon Aug 29 23:52:17 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-interface => generated 285 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:52:17.977201 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-39b2838d-1731-4dfa-9c64-e1535b9e98a9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:17.995177 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-39b2838d-1731-4dfa-9c64-e1535b9e98a9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.399814 Aug 29 23:52:17.997103 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 91/182] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:17 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:19.025800 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-43115879-06f8-4e15-8a2a-0ac3ac9f455d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:19.026966 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-43115879-06f8-4e15-8a2a-0ac3ac9f455d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:19.039079 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-43115879-06f8-4e15-8a2a-0ac3ac9f455d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:19.040032 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-43115879-06f8-4e15-8a2a-0ac3ac9f455d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:19.040853 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-43115879-06f8-4e15-8a2a-0ac3ac9f455d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:19.042190 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-43115879-06f8-4e15-8a2a-0ac3ac9f455d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:19.043069 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-43115879-06f8-4e15-8a2a-0ac3ac9f455d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:19.043961 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-43115879-06f8-4e15-8a2a-0ac3ac9f455d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:19.257036 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-43115879-06f8-4e15-8a2a-0ac3ac9f455d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:19.271938 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-43115879-06f8-4e15-8a2a-0ac3ac9f455d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.255336 Aug 29 23:52:19.282508 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 92/183] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:19 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:19.742547 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-5dbd98e4-8d30-4bd5-a45a-0a5adff6dd0f req-8b834e36-126b-4c04-b7e6-f757a9f9ee87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781bf4fc-f6e6-4efc-b757-5888339b6b3c", "tag": "70011c53-2246-46a9-9308-734ee213614a"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:19.764332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-5dbd98e4-8d30-4bd5-a45a-0a5adff6dd0f req-8b834e36-126b-4c04-b7e6-f757a9f9ee87 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:19.765932 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-5dbd98e4-8d30-4bd5-a45a-0a5adff6dd0f req-8b834e36-126b-4c04-b7e6-f757a9f9ee87 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:19.767661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-5dbd98e4-8d30-4bd5-a45a-0a5adff6dd0f req-8b834e36-126b-4c04-b7e6-f757a9f9ee87 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:19.802484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-5dbd98e4-8d30-4bd5-a45a-0a5adff6dd0f req-8b834e36-126b-4c04-b7e6-f757a9f9ee87 service nova] Creating event network-changed:70011c53-2246-46a9-9308-734ee213614a for instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c on hv-cinder-85427 Aug 29 23:52:19.812433 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-5dbd98e4-8d30-4bd5-a45a-0a5adff6dd0f req-8b834e36-126b-4c04-b7e6-f757a9f9ee87 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082831 Aug 29 23:52:19.813330 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 92/184] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:20.311409 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4bd84c00-0b4a-485a-ad03-32247f343bfb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:20.322119 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4bd84c00-0b4a-485a-ad03-32247f343bfb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:20.355020 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bd84c00-0b4a-485a-ad03-32247f343bfb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:20.357533 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bd84c00-0b4a-485a-ad03-32247f343bfb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:20.358848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bd84c00-0b4a-485a-ad03-32247f343bfb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:20.363593 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bd84c00-0b4a-485a-ad03-32247f343bfb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:20.372969 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bd84c00-0b4a-485a-ad03-32247f343bfb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:20.374585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bd84c00-0b4a-485a-ad03-32247f343bfb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:20.727118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4bd84c00-0b4a-485a-ad03-32247f343bfb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:20.735889 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4bd84c00-0b4a-485a-ad03-32247f343bfb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.439672 Aug 29 23:52:20.736748 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 93/185] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:20 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:21.759302 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2820c949-791e-4cf4-8ab9-d08614166a75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:21.760181 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2820c949-791e-4cf4-8ab9-d08614166a75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:21.772176 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2820c949-791e-4cf4-8ab9-d08614166a75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:21.773370 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2820c949-791e-4cf4-8ab9-d08614166a75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:21.774175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2820c949-791e-4cf4-8ab9-d08614166a75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:21.775923 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2820c949-791e-4cf4-8ab9-d08614166a75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:21.776647 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d3d848c5-4063-45da-8e2f-7ef1bef78ed6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:21.777421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2820c949-791e-4cf4-8ab9-d08614166a75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:21.777624 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d3d848c5-4063-45da-8e2f-7ef1bef78ed6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:21.777792 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2820c949-791e-4cf4-8ab9-d08614166a75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:21.794810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3d848c5-4063-45da-8e2f-7ef1bef78ed6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:21.795626 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3d848c5-4063-45da-8e2f-7ef1bef78ed6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:21.796781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3d848c5-4063-45da-8e2f-7ef1bef78ed6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:21.797761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3d848c5-4063-45da-8e2f-7ef1bef78ed6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:21.798970 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3d848c5-4063-45da-8e2f-7ef1bef78ed6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:21.799561 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3d848c5-4063-45da-8e2f-7ef1bef78ed6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:21.886142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d3d848c5-4063-45da-8e2f-7ef1bef78ed6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:52:22.092765 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2820c949-791e-4cf4-8ab9-d08614166a75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:22.107796 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2820c949-791e-4cf4-8ab9-d08614166a75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.352523 Aug 29 23:52:22.108832 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 93/186] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:21 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:22.137803 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:22.395948 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d3d848c5-4063-45da-8e2f-7ef1bef78ed6 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 204 len: 0 microversion: 2.1 time: 0.630840 Aug 29 23:52:22.396399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 94/187] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:52:21 2022] DELETE /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:52:22.411819 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-90875a18-4ea4-488c-ba7d-c7af357f8cbf tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:22.413079 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-90875a18-4ea4-488c-ba7d-c7af357f8cbf tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:22.424168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90875a18-4ea4-488c-ba7d-c7af357f8cbf tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:22.425377 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90875a18-4ea4-488c-ba7d-c7af357f8cbf tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:22.426155 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90875a18-4ea4-488c-ba7d-c7af357f8cbf tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:22.427456 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90875a18-4ea4-488c-ba7d-c7af357f8cbf tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:22.428285 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90875a18-4ea4-488c-ba7d-c7af357f8cbf tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:22.429080 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90875a18-4ea4-488c-ba7d-c7af357f8cbf tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:22.695883 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-90875a18-4ea4-488c-ba7d-c7af357f8cbf tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:22.707255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-90875a18-4ea4-488c-ba7d-c7af357f8cbf tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1553 microversion: 2.1 time: 0.304786 Aug 29 23:52:22.708448 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 94/188] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:22 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1553 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:23.152028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9733a3ea-d877-444c-9077-346e6f766958 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:23.153261 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9733a3ea-d877-444c-9077-346e6f766958 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:23.167496 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9733a3ea-d877-444c-9077-346e6f766958 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:23.168340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9733a3ea-d877-444c-9077-346e6f766958 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:23.169221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9733a3ea-d877-444c-9077-346e6f766958 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:23.174393 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9733a3ea-d877-444c-9077-346e6f766958 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:23.174393 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9733a3ea-d877-444c-9077-346e6f766958 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:23.174393 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9733a3ea-d877-444c-9077-346e6f766958 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:23.408427 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9733a3ea-d877-444c-9077-346e6f766958 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:23.424140 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9733a3ea-d877-444c-9077-346e6f766958 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.276028 Aug 29 23:52:23.426266 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 95/189] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:23 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:23.737792 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7560df8e-c6fc-48c9-afd0-958ab32efd39 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:23.738957 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7560df8e-c6fc-48c9-afd0-958ab32efd39 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:23.752785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7560df8e-c6fc-48c9-afd0-958ab32efd39 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:23.753671 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7560df8e-c6fc-48c9-afd0-958ab32efd39 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:23.754611 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7560df8e-c6fc-48c9-afd0-958ab32efd39 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:23.755960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7560df8e-c6fc-48c9-afd0-958ab32efd39 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:23.756798 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7560df8e-c6fc-48c9-afd0-958ab32efd39 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:23.757559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7560df8e-c6fc-48c9-afd0-958ab32efd39 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:23.953947 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7560df8e-c6fc-48c9-afd0-958ab32efd39 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:23.965602 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7560df8e-c6fc-48c9-afd0-958ab32efd39 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1553 microversion: 2.1 time: 0.235821 Aug 29 23:52:23.966740 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 95/190] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:23 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1553 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:24.462362 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-13cc342b-4064-4ae7-ab04-5ee30b43b371 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:24.463355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-13cc342b-4064-4ae7-ab04-5ee30b43b371 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:24.473137 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13cc342b-4064-4ae7-ab04-5ee30b43b371 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:24.474541 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13cc342b-4064-4ae7-ab04-5ee30b43b371 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:24.475108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13cc342b-4064-4ae7-ab04-5ee30b43b371 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:24.476279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13cc342b-4064-4ae7-ab04-5ee30b43b371 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:24.476852 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13cc342b-4064-4ae7-ab04-5ee30b43b371 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:24.477381 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13cc342b-4064-4ae7-ab04-5ee30b43b371 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:24.830272 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-13cc342b-4064-4ae7-ab04-5ee30b43b371 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:24.845509 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-13cc342b-4064-4ae7-ab04-5ee30b43b371 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.388065 Aug 29 23:52:24.847364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 96/191] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:24 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:24.991345 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8b280290-aeb5-4a74-88cb-fea7b2772195 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:24.992510 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8b280290-aeb5-4a74-88cb-fea7b2772195 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:25.003912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8b280290-aeb5-4a74-88cb-fea7b2772195 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:25.004746 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8b280290-aeb5-4a74-88cb-fea7b2772195 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:25.005424 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8b280290-aeb5-4a74-88cb-fea7b2772195 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:25.006609 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8b280290-aeb5-4a74-88cb-fea7b2772195 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:25.008374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8b280290-aeb5-4a74-88cb-fea7b2772195 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:25.008374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8b280290-aeb5-4a74-88cb-fea7b2772195 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:25.314938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8b280290-aeb5-4a74-88cb-fea7b2772195 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:25.339623 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8b280290-aeb5-4a74-88cb-fea7b2772195 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1553 microversion: 2.1 time: 0.354225 Aug 29 23:52:25.340613 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 96/192] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:24 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1553 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:25.759004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-6952f631-0e5f-4be2-87f9-36914905d9d8 req-e5c17b85-dee7-44c2-a13c-ab34b0b31fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ec8e13-8f80-45fd-a17c-02fdc4737427", "name": "network-vif-deleted", "tag": "f40880ff-7fed-43ae-a195-d6745bc86dde"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:25.776873 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-6952f631-0e5f-4be2-87f9-36914905d9d8 req-e5c17b85-dee7-44c2-a13c-ab34b0b31fac service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:25.777557 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-6952f631-0e5f-4be2-87f9-36914905d9d8 req-e5c17b85-dee7-44c2-a13c-ab34b0b31fac service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:25.778142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-6952f631-0e5f-4be2-87f9-36914905d9d8 req-e5c17b85-dee7-44c2-a13c-ab34b0b31fac service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:25.792272 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-6952f631-0e5f-4be2-87f9-36914905d9d8 req-e5c17b85-dee7-44c2-a13c-ab34b0b31fac service nova] Creating event network-vif-deleted:f40880ff-7fed-43ae-a195-d6745bc86dde for instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 on hv-cinder-85427 Aug 29 23:52:25.802180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-6952f631-0e5f-4be2-87f9-36914905d9d8 req-e5c17b85-dee7-44c2-a13c-ab34b0b31fac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051021 Aug 29 23:52:25.816812 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 97/193] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:25.885496 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5cdd1237-fa33-419d-9b2c-75e564081fee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:25.886286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5cdd1237-fa33-419d-9b2c-75e564081fee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:25.895424 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cdd1237-fa33-419d-9b2c-75e564081fee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:25.896258 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cdd1237-fa33-419d-9b2c-75e564081fee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:25.896864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cdd1237-fa33-419d-9b2c-75e564081fee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:25.897851 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cdd1237-fa33-419d-9b2c-75e564081fee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:25.898499 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cdd1237-fa33-419d-9b2c-75e564081fee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:25.899145 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cdd1237-fa33-419d-9b2c-75e564081fee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:26.104845 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5cdd1237-fa33-419d-9b2c-75e564081fee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:26.125291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5cdd1237-fa33-419d-9b2c-75e564081fee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.244444 Aug 29 23:52:26.127806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 97/194] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:25 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:26.379133 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c2712bc4-e316-4e26-b3d6-c32aa5c05cff tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:26.380256 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c2712bc4-e316-4e26-b3d6-c32aa5c05cff tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:26.388849 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-e316-4e26-b3d6-c32aa5c05cff tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:26.389655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-e316-4e26-b3d6-c32aa5c05cff tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:26.390399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-e316-4e26-b3d6-c32aa5c05cff tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:26.391747 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-e316-4e26-b3d6-c32aa5c05cff tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:26.392577 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-e316-4e26-b3d6-c32aa5c05cff tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:26.393503 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-e316-4e26-b3d6-c32aa5c05cff tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:26.503021 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c2712bc4-e316-4e26-b3d6-c32aa5c05cff tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:26.512554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c2712bc4-e316-4e26-b3d6-c32aa5c05cff tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1511 microversion: 2.1 time: 0.140219 Aug 29 23:52:26.514263 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 98/195] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:26 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1511 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:27.163935 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1043b23c-9d10-4e1f-9746-88fedc70b22d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:27.165979 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1043b23c-9d10-4e1f-9746-88fedc70b22d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:27.177936 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1043b23c-9d10-4e1f-9746-88fedc70b22d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:27.178790 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1043b23c-9d10-4e1f-9746-88fedc70b22d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:27.179500 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1043b23c-9d10-4e1f-9746-88fedc70b22d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:27.180737 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1043b23c-9d10-4e1f-9746-88fedc70b22d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:27.181748 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1043b23c-9d10-4e1f-9746-88fedc70b22d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:27.182713 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1043b23c-9d10-4e1f-9746-88fedc70b22d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:27.409994 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1043b23c-9d10-4e1f-9746-88fedc70b22d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:27.418632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1043b23c-9d10-4e1f-9746-88fedc70b22d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.262035 Aug 29 23:52:27.419273 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 98/196] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:27 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:27.552506 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9a5ca184-c8a2-4fef-bb9b-7b4f09e7cf2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:27.553531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9a5ca184-c8a2-4fef-bb9b-7b4f09e7cf2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:27.562960 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a5ca184-c8a2-4fef-bb9b-7b4f09e7cf2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:27.566182 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a5ca184-c8a2-4fef-bb9b-7b4f09e7cf2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:27.566729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a5ca184-c8a2-4fef-bb9b-7b4f09e7cf2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:27.567520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a5ca184-c8a2-4fef-bb9b-7b4f09e7cf2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:27.568173 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a5ca184-c8a2-4fef-bb9b-7b4f09e7cf2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:27.568665 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a5ca184-c8a2-4fef-bb9b-7b4f09e7cf2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:27.674497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9a5ca184-c8a2-4fef-bb9b-7b4f09e7cf2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:27.688976 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9a5ca184-c8a2-4fef-bb9b-7b4f09e7cf2c tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1511 microversion: 2.1 time: 0.144918 Aug 29 23:52:27.689907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 99/197] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:27 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:28.446763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3d623ad8-c450-4575-9e05-4a2c6ecd77b3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:28.449016 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3d623ad8-c450-4575-9e05-4a2c6ecd77b3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:28.459647 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3d623ad8-c450-4575-9e05-4a2c6ecd77b3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:28.460438 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3d623ad8-c450-4575-9e05-4a2c6ecd77b3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:28.461250 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3d623ad8-c450-4575-9e05-4a2c6ecd77b3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:28.462523 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3d623ad8-c450-4575-9e05-4a2c6ecd77b3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:28.463231 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3d623ad8-c450-4575-9e05-4a2c6ecd77b3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:28.463945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3d623ad8-c450-4575-9e05-4a2c6ecd77b3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:28.705561 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3d623ad8-c450-4575-9e05-4a2c6ecd77b3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:28.721062 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3d623ad8-c450-4575-9e05-4a2c6ecd77b3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.281005 Aug 29 23:52:28.722264 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 99/198] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:28 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:28.738517 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-371fe0b2-cda4-4179-8889-64cc36358239 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:28.739760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-371fe0b2-cda4-4179-8889-64cc36358239 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:28.753149 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-371fe0b2-cda4-4179-8889-64cc36358239 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:28.754040 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-371fe0b2-cda4-4179-8889-64cc36358239 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:28.754836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-371fe0b2-cda4-4179-8889-64cc36358239 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:28.756114 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-371fe0b2-cda4-4179-8889-64cc36358239 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:28.756929 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-371fe0b2-cda4-4179-8889-64cc36358239 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:28.758086 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-371fe0b2-cda4-4179-8889-64cc36358239 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:28.866012 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-371fe0b2-cda4-4179-8889-64cc36358239 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:28.887640 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-371fe0b2-cda4-4179-8889-64cc36358239 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1346 microversion: 2.1 time: 0.156743 Aug 29 23:52:28.888633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 100/199] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:28 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1346 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:29.747581 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8290269b-82df-4dd0-bee3-e26942ca4e78 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:29.748610 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8290269b-82df-4dd0-bee3-e26942ca4e78 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:29.759004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8290269b-82df-4dd0-bee3-e26942ca4e78 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:29.759804 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8290269b-82df-4dd0-bee3-e26942ca4e78 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:29.760503 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8290269b-82df-4dd0-bee3-e26942ca4e78 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:29.761781 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8290269b-82df-4dd0-bee3-e26942ca4e78 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:29.762593 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8290269b-82df-4dd0-bee3-e26942ca4e78 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:29.763315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8290269b-82df-4dd0-bee3-e26942ca4e78 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:29.924424 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:29.925472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:29.936563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:29.937812 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:29.939023 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:29.940399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:29.941059 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:29.941688 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:30.004074 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:30.004914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:30.005803 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:30.006581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lazy-loading 'fault' on Instance uuid b8ec8e13-8f80-45fd-a17c-02fdc4737427 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:52:30.015602 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8290269b-82df-4dd0-bee3-e26942ca4e78 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:30.025869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8290269b-82df-4dd0-bee3-e26942ca4e78 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.285117 Aug 29 23:52:30.026948 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 100/200] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:29 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:30.075088 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b88462a0d8d4e3fb4672a3f1d219c28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ada08f998844e997babd510083c205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:30.084603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-66e953df-266f-4816-b74b-1d8b7494ff0e tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 200 len: 1351 microversion: 2.1 time: 0.167743 Aug 29 23:52:30.085200 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 101/201] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:29 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 1351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:31.052987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3dc491f0-471f-48d3-9284-bf9e51e17a62 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:31.053722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3dc491f0-471f-48d3-9284-bf9e51e17a62 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:31.055591 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=71 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:31.062893 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3dc491f0-471f-48d3-9284-bf9e51e17a62 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:31.063742 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3dc491f0-471f-48d3-9284-bf9e51e17a62 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:31.064573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3dc491f0-471f-48d3-9284-bf9e51e17a62 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:31.065856 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3dc491f0-471f-48d3-9284-bf9e51e17a62 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:31.066688 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3dc491f0-471f-48d3-9284-bf9e51e17a62 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:31.067438 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3dc491f0-471f-48d3-9284-bf9e51e17a62 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:31.121513 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:31.123693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:31.135674 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:31.136553 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:31.137335 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:31.138668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:31.139934 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:31.140680 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:31.165806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] HTTP exception thrown: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Request method failure captured: Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 HTTP/1.1 Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5Oy6qq818sKpvDySzRlNp8cCUHaOLGaBR845BytGPnVw2M9raJgtI_zZ6rVLnS_F2DIc1YewBtFJR3fDlI5JRNLN2qGijvfE1kC_YHnzpMSt9MzzJICK4k4cM9uXSi_ADVbsncLqL4wYwjEHePc7r4s0TUkeMpKSutcSwgsTorwY Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: a8ada08f998844e997babd510083c205 Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:52:31.190801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a8ada08f998844e997babd510083c205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ada08f998844e997babd510083c205"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ada08f998844e997babd510083c205"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a8ada08f998844e997babd510083c205", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: a8ada08f998844e997babd510083c205 Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-DeleteServersTestJSON-811909457-project Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 2b88462a0d8d4e3fb4672a3f1d219c28 Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-DeleteServersTestJSON-811909457-project Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:31.193656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'b8ec8e13-8f80-45fd-a17c-02fdc4737427'} Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:52:31.195648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:31.199482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:31.202131 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Returning 404 to user: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:52:31.202131 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0674555d-1340-46a8-b613-4099e71f79e2 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 404 len: 111 microversion: 2.1 time: 0.078698 Aug 29 23:52:31.202131 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 102/202] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:31 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:52:31.236889 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3dc491f0-471f-48d3-9284-bf9e51e17a62 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:31.246956 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3dc491f0-471f-48d3-9284-bf9e51e17a62 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.199467 Aug 29 23:52:31.248052 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 101/203] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:31 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:31.334090 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:31.336682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:31.343669 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:31.344612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:31.345048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:31.345761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:31.346477 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:31.350573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:31.363264 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] HTTP exception thrown: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Request method failure captured: Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427/os-volume_attachments HTTP/1.1 Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5Oy6qq818sKpvDySzRlNp8cCUHaOLGaBR845BytGPnVw2M9raJgtI_zZ6rVLnS_F2DIc1YewBtFJR3fDlI5JRNLN2qGijvfE1kC_YHnzpMSt9MzzJICK4k4cM9uXSi_ADVbsncLqL4wYwjEHePc7r4s0TUkeMpKSutcSwgsTorwY Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: a8ada08f998844e997babd510083c205 Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:52:31.364977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a8ada08f998844e997babd510083c205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ada08f998844e997babd510083c205"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ada08f998844e997babd510083c205"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a8ada08f998844e997babd510083c205", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: a8ada08f998844e997babd510083c205 Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-DeleteServersTestJSON-811909457-project Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 2b88462a0d8d4e3fb4672a3f1d219c28 Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-DeleteServersTestJSON-811909457-project Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:31.367143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'server_id': 'b8ec8e13-8f80-45fd-a17c-02fdc4737427'} Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:52:31.368048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:31.369446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:31.370691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Returning 404 to user: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:52:31.370691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-cd978dbc-a8f0-4e95-a603-73016395a104 tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037663 Aug 29 23:52:31.370691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 103/204] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:52:31 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:52:32.280068 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-20311c3d-0ef2-4575-9da6-522c55f6f0b8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:32.281191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-20311c3d-0ef2-4575-9da6-522c55f6f0b8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:32.295108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-20311c3d-0ef2-4575-9da6-522c55f6f0b8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:32.296289 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-20311c3d-0ef2-4575-9da6-522c55f6f0b8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:32.298226 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-20311c3d-0ef2-4575-9da6-522c55f6f0b8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:32.299623 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-20311c3d-0ef2-4575-9da6-522c55f6f0b8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:32.300510 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-20311c3d-0ef2-4575-9da6-522c55f6f0b8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:32.301336 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-20311c3d-0ef2-4575-9da6-522c55f6f0b8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:32.531784 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-20311c3d-0ef2-4575-9da6-522c55f6f0b8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:32.547623 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-20311c3d-0ef2-4575-9da6-522c55f6f0b8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.278465 Aug 29 23:52:32.549550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 102/205] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:32 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:32.869889 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:32.870781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:32.883692 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:32.884957 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:32.885448 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:32.886197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:32.886760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:32.887192 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:32.906191 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] HTTP exception thrown: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Request method failure captured: Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: DELETE /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 HTTP/1.1 Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5Oy6qq818sKpvDySzRlNp8cCUHaOLGaBR845BytGPnVw2M9raJgtI_zZ6rVLnS_F2DIc1YewBtFJR3fDlI5JRNLN2qGijvfE1kC_YHnzpMSt9MzzJICK4k4cM9uXSi_ADVbsncLqL4wYwjEHePc7r4s0TUkeMpKSutcSwgsTorwY Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: a8ada08f998844e997babd510083c205 Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:52:32.908836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a8ada08f998844e997babd510083c205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ada08f998844e997babd510083c205"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ada08f998844e997babd510083c205"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a8ada08f998844e997babd510083c205", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: a8ada08f998844e997babd510083c205 Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-DeleteServersTestJSON-811909457-project Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 2b88462a0d8d4e3fb4672a3f1d219c28 Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-DeleteServersTestJSON-811909457-project Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:32.911155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'b8ec8e13-8f80-45fd-a17c-02fdc4737427'} Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:52:32.912399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:32.913488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:52:32.914636 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Returning 404 to user: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:52:32.914636 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-73b1ca13-f9a3-4326-b48a-77bf088c615f tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 404 len: 111 microversion: 2.1 time: 0.047336 Aug 29 23:52:32.914636 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 104/206] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:52:32 2022] DELETE /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:52:32.920739 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:32.921367 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] [instance: b8ec8e13-8f80-45fd-a17c-02fdc4737427] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:32.929777 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:32.930633 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:32.931372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:32.932363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:32.933061 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:32.933724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:32.954921 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] HTTP exception thrown: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Request method failure captured: Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 HTTP/1.1 Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD5Oy6qq818sKpvDySzRlNp8cCUHaOLGaBR845BytGPnVw2M9raJgtI_zZ6rVLnS_F2DIc1YewBtFJR3fDlI5JRNLN2qGijvfE1kC_YHnzpMSt9MzzJICK4k4cM9uXSi_ADVbsncLqL4wYwjEHePc7r4s0TUkeMpKSutcSwgsTorwY Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: a8ada08f998844e997babd510083c205 Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:52:32.960427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a8ada08f998844e997babd510083c205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ada08f998844e997babd510083c205"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a8ada08f998844e997babd510083c205"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a8ada08f998844e997babd510083c205", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: a8ada08f998844e997babd510083c205 Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-DeleteServersTestJSON-811909457 Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-DeleteServersTestJSON-811909457-project Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 2b88462a0d8d4e3fb4672a3f1d219c28 Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-DeleteServersTestJSON-811909457-project Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:32.970083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': 'b8ec8e13-8f80-45fd-a17c-02fdc4737427'} Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:52:32.972071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. Aug 29 23:52:32.975257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:52:32.977388 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] Returning 404 to user: Instance b8ec8e13-8f80-45fd-a17c-02fdc4737427 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:52:32.977388 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c18e146b-bb93-4240-993a-e3a4a05868cc tempest-DeleteServersTestJSON-811909457 tempest-DeleteServersTestJSON-811909457-project] 10.222.0.58 "GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427" status: 404 len: 111 microversion: 2.1 time: 0.045829 Aug 29 23:52:32.977388 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 103/207] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:32 2022] GET /compute/v2.1/servers/b8ec8e13-8f80-45fd-a17c-02fdc4737427 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:52:33.579165 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8a8ac84f-ac3a-4959-9a28-e9c75e461910 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:33.580669 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8a8ac84f-ac3a-4959-9a28-e9c75e461910 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:33.591737 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a8ac84f-ac3a-4959-9a28-e9c75e461910 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:33.592884 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a8ac84f-ac3a-4959-9a28-e9c75e461910 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:33.593620 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a8ac84f-ac3a-4959-9a28-e9c75e461910 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:33.594529 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a8ac84f-ac3a-4959-9a28-e9c75e461910 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:33.595236 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a8ac84f-ac3a-4959-9a28-e9c75e461910 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:33.595931 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a8ac84f-ac3a-4959-9a28-e9c75e461910 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:33.853151 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8a8ac84f-ac3a-4959-9a28-e9c75e461910 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:33.866210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8a8ac84f-ac3a-4959-9a28-e9c75e461910 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.293030 Aug 29 23:52:33.867476 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 105/208] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:33 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:34.897706 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7b9b06be-038a-4273-a24f-cc92d4eec738 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:34.898583 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7b9b06be-038a-4273-a24f-cc92d4eec738 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:34.908809 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b9b06be-038a-4273-a24f-cc92d4eec738 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:34.910475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b9b06be-038a-4273-a24f-cc92d4eec738 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:34.912356 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b9b06be-038a-4273-a24f-cc92d4eec738 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:34.917128 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b9b06be-038a-4273-a24f-cc92d4eec738 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:34.917864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b9b06be-038a-4273-a24f-cc92d4eec738 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:34.919296 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b9b06be-038a-4273-a24f-cc92d4eec738 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:34.930392 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:35.340231 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7b9b06be-038a-4273-a24f-cc92d4eec738 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:35.369881 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7b9b06be-038a-4273-a24f-cc92d4eec738 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.475915 Aug 29 23:52:35.381918 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 104/209] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:34 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:36.417058 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4f7ca95b-79c6-44e2-b2bc-8772eedeb880 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:36.418905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4f7ca95b-79c6-44e2-b2bc-8772eedeb880 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:36.433048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:36.438974 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4f7ca95b-79c6-44e2-b2bc-8772eedeb880 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:36.442500 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4f7ca95b-79c6-44e2-b2bc-8772eedeb880 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:36.442500 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4f7ca95b-79c6-44e2-b2bc-8772eedeb880 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:36.442500 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4f7ca95b-79c6-44e2-b2bc-8772eedeb880 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:36.442855 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4f7ca95b-79c6-44e2-b2bc-8772eedeb880 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:36.444263 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4f7ca95b-79c6-44e2-b2bc-8772eedeb880 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:36.823552 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4f7ca95b-79c6-44e2-b2bc-8772eedeb880 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:36.845861 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4f7ca95b-79c6-44e2-b2bc-8772eedeb880 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.437679 Aug 29 23:52:36.847366 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 106/210] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:36 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:37.872718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8586e72a-d95c-4f14-b473-62da5e321e11 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:37.873475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8586e72a-d95c-4f14-b473-62da5e321e11 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:37.891921 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8586e72a-d95c-4f14-b473-62da5e321e11 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:37.894940 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8586e72a-d95c-4f14-b473-62da5e321e11 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:37.895642 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8586e72a-d95c-4f14-b473-62da5e321e11 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:37.896379 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8586e72a-d95c-4f14-b473-62da5e321e11 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:37.899759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8586e72a-d95c-4f14-b473-62da5e321e11 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:37.899759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8586e72a-d95c-4f14-b473-62da5e321e11 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:38.336392 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8586e72a-d95c-4f14-b473-62da5e321e11 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:38.358339 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8586e72a-d95c-4f14-b473-62da5e321e11 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.492143 Aug 29 23:52:38.361221 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 105/211] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:37 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:39.384864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3fc80af9-d992-4ae3-9636-1d8061dc3e86 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:39.385873 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3fc80af9-d992-4ae3-9636-1d8061dc3e86 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:39.412538 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fc80af9-d992-4ae3-9636-1d8061dc3e86 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:39.413340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fc80af9-d992-4ae3-9636-1d8061dc3e86 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:39.413988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fc80af9-d992-4ae3-9636-1d8061dc3e86 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:39.417991 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fc80af9-d992-4ae3-9636-1d8061dc3e86 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:39.418788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fc80af9-d992-4ae3-9636-1d8061dc3e86 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:39.419392 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fc80af9-d992-4ae3-9636-1d8061dc3e86 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:39.814348 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3fc80af9-d992-4ae3-9636-1d8061dc3e86 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:39.826274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3fc80af9-d992-4ae3-9636-1d8061dc3e86 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.446706 Aug 29 23:52:39.826926 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 107/212] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:39 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:40.854740 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-78686741-8ca5-447d-b142-7778e1ec0aa8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:40.855817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-78686741-8ca5-447d-b142-7778e1ec0aa8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:40.868455 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78686741-8ca5-447d-b142-7778e1ec0aa8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:40.869995 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78686741-8ca5-447d-b142-7778e1ec0aa8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:40.871205 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78686741-8ca5-447d-b142-7778e1ec0aa8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:40.872696 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78686741-8ca5-447d-b142-7778e1ec0aa8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:40.878939 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78686741-8ca5-447d-b142-7778e1ec0aa8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:40.878939 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78686741-8ca5-447d-b142-7778e1ec0aa8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:41.128618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-78686741-8ca5-447d-b142-7778e1ec0aa8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:41.142305 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-78686741-8ca5-447d-b142-7778e1ec0aa8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.294462 Aug 29 23:52:41.145840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 106/213] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:40 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:42.176684 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a5ef0cc7-1436-405e-8950-11e32de2afef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:42.177368 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a5ef0cc7-1436-405e-8950-11e32de2afef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:42.184484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a5ef0cc7-1436-405e-8950-11e32de2afef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:42.185079 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a5ef0cc7-1436-405e-8950-11e32de2afef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:42.185688 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a5ef0cc7-1436-405e-8950-11e32de2afef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:42.186561 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a5ef0cc7-1436-405e-8950-11e32de2afef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:42.187383 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a5ef0cc7-1436-405e-8950-11e32de2afef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:42.188049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a5ef0cc7-1436-405e-8950-11e32de2afef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:42.401888 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a5ef0cc7-1436-405e-8950-11e32de2afef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:42.411752 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a5ef0cc7-1436-405e-8950-11e32de2afef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.240160 Aug 29 23:52:42.412339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 108/214] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:42 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:43.458052 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0138ee16-e8d9-490a-88de-72599433ecf7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:43.460332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0138ee16-e8d9-490a-88de-72599433ecf7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:43.473076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0138ee16-e8d9-490a-88de-72599433ecf7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:43.473377 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0138ee16-e8d9-490a-88de-72599433ecf7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:43.474448 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0138ee16-e8d9-490a-88de-72599433ecf7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:43.475909 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0138ee16-e8d9-490a-88de-72599433ecf7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:43.476971 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0138ee16-e8d9-490a-88de-72599433ecf7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:43.477938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0138ee16-e8d9-490a-88de-72599433ecf7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:43.740180 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0138ee16-e8d9-490a-88de-72599433ecf7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:43.753210 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0138ee16-e8d9-490a-88de-72599433ecf7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1522 microversion: 2.1 time: 0.306056 Aug 29 23:52:43.753823 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 107/215] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:43 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:44.780060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4d9c628f-a7f1-47af-aea6-2ac0f2f5d530 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:44.781119 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4d9c628f-a7f1-47af-aea6-2ac0f2f5d530 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:44.793302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d9c628f-a7f1-47af-aea6-2ac0f2f5d530 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:44.794036 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d9c628f-a7f1-47af-aea6-2ac0f2f5d530 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:44.794719 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d9c628f-a7f1-47af-aea6-2ac0f2f5d530 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:44.796378 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d9c628f-a7f1-47af-aea6-2ac0f2f5d530 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:44.798327 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d9c628f-a7f1-47af-aea6-2ac0f2f5d530 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:44.799610 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4d9c628f-a7f1-47af-aea6-2ac0f2f5d530 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:45.020699 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4d9c628f-a7f1-47af-aea6-2ac0f2f5d530 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:45.036196 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4d9c628f-a7f1-47af-aea6-2ac0f2f5d530 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1502 microversion: 2.1 time: 0.263442 Aug 29 23:52:45.037218 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 109/216] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:44 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:45.084408 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-63425cca-dc50-4ed1-a270-ebda027ca6a3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:45.085432 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-63425cca-dc50-4ed1-a270-ebda027ca6a3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:45.098241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63425cca-dc50-4ed1-a270-ebda027ca6a3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:45.099135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63425cca-dc50-4ed1-a270-ebda027ca6a3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:45.099914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63425cca-dc50-4ed1-a270-ebda027ca6a3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:45.101247 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63425cca-dc50-4ed1-a270-ebda027ca6a3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:45.102368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63425cca-dc50-4ed1-a270-ebda027ca6a3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:45.103128 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63425cca-dc50-4ed1-a270-ebda027ca6a3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:45.332526 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-63425cca-dc50-4ed1-a270-ebda027ca6a3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:45.347947 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-63425cca-dc50-4ed1-a270-ebda027ca6a3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1515 microversion: 2.1 time: 0.269737 Aug 29 23:52:45.349472 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 108/217] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:45 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:48.260122 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-470bc6d1-7a14-4ff4-a71a-cef3b67e8ed8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:48.263270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-470bc6d1-7a14-4ff4-a71a-cef3b67e8ed8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:48.271847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470bc6d1-7a14-4ff4-a71a-cef3b67e8ed8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:48.272631 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470bc6d1-7a14-4ff4-a71a-cef3b67e8ed8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:48.273224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470bc6d1-7a14-4ff4-a71a-cef3b67e8ed8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:48.274172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470bc6d1-7a14-4ff4-a71a-cef3b67e8ed8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:48.274829 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470bc6d1-7a14-4ff4-a71a-cef3b67e8ed8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:48.275404 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470bc6d1-7a14-4ff4-a71a-cef3b67e8ed8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:48.310252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-470bc6d1-7a14-4ff4-a71a-cef3b67e8ed8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lazy-loading 'flavor' on Instance uuid edecb793-ad02-4b6f-addc-020ce872a118 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:52:48.709921 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-470bc6d1-7a14-4ff4-a71a-cef3b67e8ed8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118/action" status: 200 len: 32 microversion: 2.1 time: 0.455103 Aug 29 23:52:48.710780 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 110/218] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:52:48 2022] POST /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118/action => generated 32 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:52:48.725058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-83d462f2-f8e8-4dc6-af7b-c2025297260d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:48.726754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-83d462f2-f8e8-4dc6-af7b-c2025297260d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:48.735797 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83d462f2-f8e8-4dc6-af7b-c2025297260d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:48.736538 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83d462f2-f8e8-4dc6-af7b-c2025297260d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:48.737201 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83d462f2-f8e8-4dc6-af7b-c2025297260d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:48.738349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83d462f2-f8e8-4dc6-af7b-c2025297260d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:48.739079 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83d462f2-f8e8-4dc6-af7b-c2025297260d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:48.739756 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83d462f2-f8e8-4dc6-af7b-c2025297260d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:48.920809 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-83d462f2-f8e8-4dc6-af7b-c2025297260d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:48.930732 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-83d462f2-f8e8-4dc6-af7b-c2025297260d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.211448 Aug 29 23:52:48.931397 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 109/219] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:48 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:49.958267 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-34d6dd15-4787-40da-83e2-89bbe60d38b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:49.958916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-34d6dd15-4787-40da-83e2-89bbe60d38b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:49.965781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34d6dd15-4787-40da-83e2-89bbe60d38b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:49.966271 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34d6dd15-4787-40da-83e2-89bbe60d38b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:49.966731 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34d6dd15-4787-40da-83e2-89bbe60d38b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:49.967514 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34d6dd15-4787-40da-83e2-89bbe60d38b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:49.968641 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34d6dd15-4787-40da-83e2-89bbe60d38b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:49.969070 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34d6dd15-4787-40da-83e2-89bbe60d38b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:50.120985 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-34d6dd15-4787-40da-83e2-89bbe60d38b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:50.126102 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:50.131056 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-34d6dd15-4787-40da-83e2-89bbe60d38b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.177916 Aug 29 23:52:50.136334 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 111/220] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:49 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:51.157699 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-98126e51-1c45-456c-8caa-f95e75e0325c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:51.158749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-98126e51-1c45-456c-8caa-f95e75e0325c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:51.165186 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-98126e51-1c45-456c-8caa-f95e75e0325c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:51.165587 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-98126e51-1c45-456c-8caa-f95e75e0325c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:51.166014 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-98126e51-1c45-456c-8caa-f95e75e0325c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:51.166755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-98126e51-1c45-456c-8caa-f95e75e0325c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:51.167234 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-98126e51-1c45-456c-8caa-f95e75e0325c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:51.167655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-98126e51-1c45-456c-8caa-f95e75e0325c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:51.324524 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-98126e51-1c45-456c-8caa-f95e75e0325c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:51.333427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-98126e51-1c45-456c-8caa-f95e75e0325c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.183210 Aug 29 23:52:51.334048 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 110/221] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:51 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:52.358512 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7169197b-ed24-4a17-bc3c-b8f0065a604e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:52.359539 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7169197b-ed24-4a17-bc3c-b8f0065a604e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:52.369310 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7169197b-ed24-4a17-bc3c-b8f0065a604e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:52.370055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7169197b-ed24-4a17-bc3c-b8f0065a604e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:52.370715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7169197b-ed24-4a17-bc3c-b8f0065a604e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:52.371531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7169197b-ed24-4a17-bc3c-b8f0065a604e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:52.372081 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7169197b-ed24-4a17-bc3c-b8f0065a604e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:52.372819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7169197b-ed24-4a17-bc3c-b8f0065a604e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:52.542264 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7169197b-ed24-4a17-bc3c-b8f0065a604e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:52.551386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7169197b-ed24-4a17-bc3c-b8f0065a604e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.199368 Aug 29 23:52:52.551982 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 112/222] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:52 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:53.573732 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b7ad4d74-1338-4e0a-9f43-9d1b42f6a4e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:53.574300 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b7ad4d74-1338-4e0a-9f43-9d1b42f6a4e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:53.582011 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7ad4d74-1338-4e0a-9f43-9d1b42f6a4e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.582584 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7ad4d74-1338-4e0a-9f43-9d1b42f6a4e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.583066 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7ad4d74-1338-4e0a-9f43-9d1b42f6a4e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.583887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7ad4d74-1338-4e0a-9f43-9d1b42f6a4e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:53.584519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7ad4d74-1338-4e0a-9f43-9d1b42f6a4e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:53.584921 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7ad4d74-1338-4e0a-9f43-9d1b42f6a4e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:53.772113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b7ad4d74-1338-4e0a-9f43-9d1b42f6a4e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:53.784639 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b7ad4d74-1338-4e0a-9f43-9d1b42f6a4e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.214709 Aug 29 23:52:53.785642 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 111/223] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:53 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:54.434701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d2089909-0efb-4458-9685-44f37c5ac146 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:54.435283 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d2089909-0efb-4458-9685-44f37c5ac146 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:54.443771 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2089909-0efb-4458-9685-44f37c5ac146 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.444310 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2089909-0efb-4458-9685-44f37c5ac146 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.444809 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2089909-0efb-4458-9685-44f37c5ac146 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.445787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2089909-0efb-4458-9685-44f37c5ac146 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.446302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2089909-0efb-4458-9685-44f37c5ac146 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.446860 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2089909-0efb-4458-9685-44f37c5ac146 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.477104 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d2089909-0efb-4458-9685-44f37c5ac146 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/ips" status: 200 len: 146 microversion: 2.1 time: 0.046320 Aug 29 23:52:54.477941 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 113/224] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Aug 29 23:52:54 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:52:54.820459 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-00667b2b-2ccd-4f45-ab75-0854923dc196 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:54.821199 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-00667b2b-2ccd-4f45-ab75-0854923dc196 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:54.829494 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00667b2b-2ccd-4f45-ab75-0854923dc196 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.830170 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00667b2b-2ccd-4f45-ab75-0854923dc196 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.830702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00667b2b-2ccd-4f45-ab75-0854923dc196 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.831520 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00667b2b-2ccd-4f45-ab75-0854923dc196 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:54.832086 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00667b2b-2ccd-4f45-ab75-0854923dc196 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:54.832552 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00667b2b-2ccd-4f45-ab75-0854923dc196 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:54.990545 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-00667b2b-2ccd-4f45-ab75-0854923dc196 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:54.998909 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-00667b2b-2ccd-4f45-ab75-0854923dc196 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.182274 Aug 29 23:52:54.999896 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 112/225] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:54 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:56.033413 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7a879439-3d49-4562-9d25-65316cb3d5b6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:56.034047 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7a879439-3d49-4562-9d25-65316cb3d5b6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:56.041298 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7a879439-3d49-4562-9d25-65316cb3d5b6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:56.041792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7a879439-3d49-4562-9d25-65316cb3d5b6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:56.042225 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7a879439-3d49-4562-9d25-65316cb3d5b6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:56.043045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7a879439-3d49-4562-9d25-65316cb3d5b6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:56.043445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7a879439-3d49-4562-9d25-65316cb3d5b6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:56.043861 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7a879439-3d49-4562-9d25-65316cb3d5b6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:56.214114 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7a879439-3d49-4562-9d25-65316cb3d5b6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:56.226290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7a879439-3d49-4562-9d25-65316cb3d5b6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.197784 Aug 29 23:52:56.227371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 114/226] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:56 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:57.256511 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c7549028-1b73-4d0f-850f-2a8f45d7bd8b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:57.257534 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c7549028-1b73-4d0f-850f-2a8f45d7bd8b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:57.266215 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7549028-1b73-4d0f-850f-2a8f45d7bd8b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:57.266730 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7549028-1b73-4d0f-850f-2a8f45d7bd8b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:57.267160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7549028-1b73-4d0f-850f-2a8f45d7bd8b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:57.267907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7549028-1b73-4d0f-850f-2a8f45d7bd8b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:57.268350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7549028-1b73-4d0f-850f-2a8f45d7bd8b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:57.268763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7549028-1b73-4d0f-850f-2a8f45d7bd8b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:57.458582 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c7549028-1b73-4d0f-850f-2a8f45d7bd8b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:57.474123 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c7549028-1b73-4d0f-850f-2a8f45d7bd8b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.225437 Aug 29 23:52:57.475705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 113/227] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:57 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:52:58.498401 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-716f2986-2042-4248-86c9-d7e0317e682a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:58.499138 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-716f2986-2042-4248-86c9-d7e0317e682a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:58.506761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-716f2986-2042-4248-86c9-d7e0317e682a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.507299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-716f2986-2042-4248-86c9-d7e0317e682a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.507742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-716f2986-2042-4248-86c9-d7e0317e682a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.508474 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-716f2986-2042-4248-86c9-d7e0317e682a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.508972 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-716f2986-2042-4248-86c9-d7e0317e682a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.509404 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-716f2986-2042-4248-86c9-d7e0317e682a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.727054 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-716f2986-2042-4248-86c9-d7e0317e682a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:58.741288 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-716f2986-2042-4248-86c9-d7e0317e682a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.246916 Aug 29 23:52:58.741973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 115/228] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:58 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:52:58.808735 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f6db5a55-136e-441d-86c3-b2e8c261861c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcf83db6-2525-4de3-bed0-37b66231b23c"}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:52:58.811943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f6db5a55-136e-441d-86c3-b2e8c261861c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:58.818829 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6db5a55-136e-441d-86c3-b2e8c261861c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.819330 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6db5a55-136e-441d-86c3-b2e8c261861c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.819760 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6db5a55-136e-441d-86c3-b2e8c261861c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:58.820466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6db5a55-136e-441d-86c3-b2e8c261861c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:58.820938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6db5a55-136e-441d-86c3-b2e8c261861c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:58.821364 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f6db5a55-136e-441d-86c3-b2e8c261861c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:59.766515 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-970deb06-301a-47f7-8cd0-1f761247604a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:52:59.768078 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-970deb06-301a-47f7-8cd0-1f761247604a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:52:59.780372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-970deb06-301a-47f7-8cd0-1f761247604a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:59.781102 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-970deb06-301a-47f7-8cd0-1f761247604a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:59.781749 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-970deb06-301a-47f7-8cd0-1f761247604a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:59.782845 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-970deb06-301a-47f7-8cd0-1f761247604a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:52:59.783514 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-970deb06-301a-47f7-8cd0-1f761247604a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:52:59.784292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-970deb06-301a-47f7-8cd0-1f761247604a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:52:59.972994 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-970deb06-301a-47f7-8cd0-1f761247604a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:52:59.982958 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-970deb06-301a-47f7-8cd0-1f761247604a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.221666 Aug 29 23:52:59.983521 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 116/229] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:52:59 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:00.281816 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f6db5a55-136e-441d-86c3-b2e8c261861c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.473628 Aug 29 23:53:00.281816 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 114/230] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:52:58 2022] POST /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/os-volume_attachments => generated 194 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:01.007781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-00360a6e-9f53-4248-9aed-971e45933566 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:01.008656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-00360a6e-9f53-4248-9aed-971e45933566 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:01.021864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-00360a6e-9f53-4248-9aed-971e45933566 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.023118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-00360a6e-9f53-4248-9aed-971e45933566 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.024278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-00360a6e-9f53-4248-9aed-971e45933566 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.025564 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-00360a6e-9f53-4248-9aed-971e45933566 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:01.027404 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-00360a6e-9f53-4248-9aed-971e45933566 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:01.028426 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-00360a6e-9f53-4248-9aed-971e45933566 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:01.284415 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-00360a6e-9f53-4248-9aed-971e45933566 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:01.293018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-00360a6e-9f53-4248-9aed-971e45933566 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.291310 Aug 29 23:53:01.293660 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 117/231] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:01 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:02.317961 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-88233bae-e954-4582-9278-4a878e71e594 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:02.319336 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-88233bae-e954-4582-9278-4a878e71e594 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:02.326628 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=28 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:02.331945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-88233bae-e954-4582-9278-4a878e71e594 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:02.331945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-88233bae-e954-4582-9278-4a878e71e594 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:02.331945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-88233bae-e954-4582-9278-4a878e71e594 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:02.331945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-88233bae-e954-4582-9278-4a878e71e594 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:02.332392 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-88233bae-e954-4582-9278-4a878e71e594 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:02.332392 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-88233bae-e954-4582-9278-4a878e71e594 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:02.517043 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-88233bae-e954-4582-9278-4a878e71e594 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:02.531772 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-88233bae-e954-4582-9278-4a878e71e594 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.219150 Aug 29 23:53:02.543576 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 115/232] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:02 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:03.557445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1fe42429-7701-4c7f-992a-0efcc1abd115 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:03.558161 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1fe42429-7701-4c7f-992a-0efcc1abd115 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:03.585542 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1fe42429-7701-4c7f-992a-0efcc1abd115 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:03.589997 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1fe42429-7701-4c7f-992a-0efcc1abd115 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:03.590467 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1fe42429-7701-4c7f-992a-0efcc1abd115 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:03.594315 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1fe42429-7701-4c7f-992a-0efcc1abd115 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:03.594315 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1fe42429-7701-4c7f-992a-0efcc1abd115 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:03.597424 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1fe42429-7701-4c7f-992a-0efcc1abd115 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:03.882475 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1fe42429-7701-4c7f-992a-0efcc1abd115 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:03.893466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1fe42429-7701-4c7f-992a-0efcc1abd115 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.340013 Aug 29 23:53:03.894346 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 118/233] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:03 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:04.931696 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5435d4d9-51df-48d1-8ee7-abe2ea37bdd1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:04.932950 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5435d4d9-51df-48d1-8ee7-abe2ea37bdd1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:04.943352 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5435d4d9-51df-48d1-8ee7-abe2ea37bdd1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:04.945081 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5435d4d9-51df-48d1-8ee7-abe2ea37bdd1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:04.945081 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5435d4d9-51df-48d1-8ee7-abe2ea37bdd1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:04.945411 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5435d4d9-51df-48d1-8ee7-abe2ea37bdd1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:04.946051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5435d4d9-51df-48d1-8ee7-abe2ea37bdd1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:04.946613 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5435d4d9-51df-48d1-8ee7-abe2ea37bdd1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.147748 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5435d4d9-51df-48d1-8ee7-abe2ea37bdd1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:05.163993 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5435d4d9-51df-48d1-8ee7-abe2ea37bdd1 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1501 microversion: 2.1 time: 0.235708 Aug 29 23:53:05.165735 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 116/234] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:04 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1501 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:05.206340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0f87ddf-03bc-478d-bf27-36cd0fa2ae26"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:05.214299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:05.226318 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.227741 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.228820 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.230525 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.231697 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.233006 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.267867 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] HTTP exception thrown: Cannot 'attach_volume' instance edecb793-ad02-4b6f-addc-020ce872a118 while it is in vm_state rescued Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Request method failure captured: Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: POST /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118/os-volume_attachments HTTP/1.1 Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 74 Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD4v-eu6rZBlAlqzwBcCkUx2NN4-TegknEgxG_yMBpHgCTjDu6aYx-1CgSWLVYCiicIRI8khSsWFJTLENz4gGINoHk92r89UKQyas6aJSylF_6htN8yd_yfF4ND3Mc7ip6d7BUL4TD_MMjoD6qH6Ivg1CAG_Ywi9Vp6la1BTmcb1Ak Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: cb38bc3ae5c14e4c8385809d84573600 Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:53:05.269666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb38bc3ae5c14e4c8385809d84573600", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: cb38bc3ae5c14e4c8385809d84573600 Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-ServerRescueNegativeTestJSON-660246268-project Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 734d44438bfb4a79a68aa6705e49b1e9 Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-660246268-project Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {"volumeAttachment": {"volumeId": "a0f87ddf-03bc-478d-bf27-36cd0fa2ae26"}} Aug 29 23:53:05.272549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Cannot 'attach_volume' instance edecb793-ad02-4b6f-addc-020ce872a118 while it is in vm_state rescued Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'server_id': 'edecb793-ad02-4b6f-addc-020ce872a118', 'body': {'volumeAttachment': {'volumeId': 'a0f87ddf-03bc-478d-bf27-36cd0fa2ae26'}}} Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance edecb793-ad02-4b6f-addc-020ce872a118 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:05.274224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance edecb793-ad02-4b6f-addc-020ce872a118 while it is in vm_state rescued Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:05.277287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:05.281362 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:05.281362 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:05.281362 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance edecb793-ad02-4b6f-addc-020ce872a118 while it is in vm_state rescued Aug 29 23:53:05.281362 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:53:05.281362 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Returning 409 to user: Cannot 'attach_volume' instance edecb793-ad02-4b6f-addc-020ce872a118 while it is in vm_state rescued {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:05.281362 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a708b491-bf9c-426c-894b-0f9bdc9d11ba tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069649 Aug 29 23:53:05.283986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-78e7c9c1-c611-4743-816f-56a41d51a266 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:05.283986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-78e7c9c1-c611-4743-816f-56a41d51a266 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:05.286871 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 119/235] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:53:05 2022] POST /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118/os-volume_attachments => generated 152 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 23:53:05.288003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78e7c9c1-c611-4743-816f-56a41d51a266 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.288495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78e7c9c1-c611-4743-816f-56a41d51a266 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.288930 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78e7c9c1-c611-4743-816f-56a41d51a266 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.289635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78e7c9c1-c611-4743-816f-56a41d51a266 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.290092 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78e7c9c1-c611-4743-816f-56a41d51a266 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.290540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78e7c9c1-c611-4743-816f-56a41d51a266 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.295281 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:05.615523 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-78e7c9c1-c611-4743-816f-56a41d51a266 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118/action" status: 202 len: 0 microversion: 2.1 time: 0.338493 Aug 29 23:53:05.616864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 117/236] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:53:05 2022] POST /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:53:05.626555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c7c87ccd-0e23-4629-965a-8bce1cbdbb2e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:05.627191 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c7c87ccd-0e23-4629-965a-8bce1cbdbb2e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:05.637051 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7c87ccd-0e23-4629-965a-8bce1cbdbb2e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.637551 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7c87ccd-0e23-4629-965a-8bce1cbdbb2e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.638627 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7c87ccd-0e23-4629-965a-8bce1cbdbb2e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.639384 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7c87ccd-0e23-4629-965a-8bce1cbdbb2e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:05.640995 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7c87ccd-0e23-4629-965a-8bce1cbdbb2e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:05.641453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7c87ccd-0e23-4629-965a-8bce1cbdbb2e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:05.839190 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c7c87ccd-0e23-4629-965a-8bce1cbdbb2e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:05.853832 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c7c87ccd-0e23-4629-965a-8bce1cbdbb2e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1509 microversion: 2.1 time: 0.231857 Aug 29 23:53:05.854665 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 120/237] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:05 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:06.881324 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9e6ef599-22f9-4592-bcc5-89c250fd6916 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:06.882163 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9e6ef599-22f9-4592-bcc5-89c250fd6916 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:06.892168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e6ef599-22f9-4592-bcc5-89c250fd6916 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:06.892982 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e6ef599-22f9-4592-bcc5-89c250fd6916 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:06.893575 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e6ef599-22f9-4592-bcc5-89c250fd6916 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:06.894448 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e6ef599-22f9-4592-bcc5-89c250fd6916 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:06.894959 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e6ef599-22f9-4592-bcc5-89c250fd6916 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:06.895413 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e6ef599-22f9-4592-bcc5-89c250fd6916 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:07.160826 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9e6ef599-22f9-4592-bcc5-89c250fd6916 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:07.185499 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9e6ef599-22f9-4592-bcc5-89c250fd6916 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1509 microversion: 2.1 time: 0.308583 Aug 29 23:53:07.190521 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 118/238] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:06 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1509 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:07.398434 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1113691182", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "networks": [{"uuid": "9679b41b-badb-474e-91ed-865a85109ffa"}]}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:07.415595 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=30 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:07.496714 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] validate_networks() for [('9679b41b-badb-474e-91ed-865a85109ffa', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:53:08.007888 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:53:08.008342 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:53:08.009032 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:53:08.009452 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:53:08.009867 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:53:08.021639 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.022685 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.023432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.024773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.025619 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.026289 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.062179 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Getting quotas for project 87299c60c42b43e7bf7e8f92f30ae87d. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:53:08.070301 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Getting quotas for user 74d57012e9a04960b6c5dde2243dafbc and project 87299c60c42b43e7bf7e8f92f30ae87d. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:53:08.092894 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:53:08.095370 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:53:08.226119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4ed3f6bf-50b3-4abd-b900-ed4b5567f332 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:08.227312 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4ed3f6bf-50b3-4abd-b900-ed4b5567f332 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:08.235712 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ed3f6bf-50b3-4abd-b900-ed4b5567f332 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.236353 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ed3f6bf-50b3-4abd-b900-ed4b5567f332 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.237104 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ed3f6bf-50b3-4abd-b900-ed4b5567f332 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.237912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ed3f6bf-50b3-4abd-b900-ed4b5567f332 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:08.238512 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ed3f6bf-50b3-4abd-b900-ed4b5567f332 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:08.239048 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ed3f6bf-50b3-4abd-b900-ed4b5567f332 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:08.343465 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-70e96cae-5744-4414-a37c-e579f1bc76cb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949493 Aug 29 23:53:08.345239 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 121/239] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:53:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 23:53:08.361443 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-56b4721b-1ece-4371-989c-996f12250a17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:08.362223 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-56b4721b-1ece-4371-989c-996f12250a17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:08.465974 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-56b4721b-1ece-4371-989c-996f12250a17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:08.477618 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-56b4721b-1ece-4371-989c-996f12250a17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1214 microversion: 2.1 time: 0.120191 Aug 29 23:53:08.492685 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 122/240] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:08 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:08.503943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-4ed3f6bf-50b3-4abd-b900-ed4b5567f332 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:08.514161 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4ed3f6bf-50b3-4abd-b900-ed4b5567f332 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1509 microversion: 2.1 time: 0.291175 Aug 29 23:53:08.515180 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 119/241] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:08 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:09.502641 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e9fed9d1-89d6-45ef-9062-86abb77cbd2d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:09.504265 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e9fed9d1-89d6-45ef-9062-86abb77cbd2d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:09.545575 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7e59827f-c8af-4b3b-b03f-1549621f64e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:09.546216 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7e59827f-c8af-4b3b-b03f-1549621f64e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:09.575439 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e59827f-c8af-4b3b-b03f-1549621f64e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.576220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e59827f-c8af-4b3b-b03f-1549621f64e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.583710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e59827f-c8af-4b3b-b03f-1549621f64e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:09.584498 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e59827f-c8af-4b3b-b03f-1549621f64e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:09.584981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e59827f-c8af-4b3b-b03f-1549621f64e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:09.585409 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e59827f-c8af-4b3b-b03f-1549621f64e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:09.610572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e9fed9d1-89d6-45ef-9062-86abb77cbd2d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:09.624142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e9fed9d1-89d6-45ef-9062-86abb77cbd2d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1214 microversion: 2.1 time: 0.127253 Aug 29 23:53:09.625576 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 123/242] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:09 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:09.818117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7e59827f-c8af-4b3b-b03f-1549621f64e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:09.827787 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7e59827f-c8af-4b3b-b03f-1549621f64e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1515 microversion: 2.1 time: 0.293641 Aug 29 23:53:09.828383 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 120/243] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:09 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:10.660174 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0ef6d687-91e7-4d39-a919-bedfe4daf24c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:10.662040 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0ef6d687-91e7-4d39-a919-bedfe4daf24c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:10.667580 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ef6d687-91e7-4d39-a919-bedfe4daf24c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:10.667735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ef6d687-91e7-4d39-a919-bedfe4daf24c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:10.668798 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ef6d687-91e7-4d39-a919-bedfe4daf24c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:10.669078 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ef6d687-91e7-4d39-a919-bedfe4daf24c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:10.669781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ef6d687-91e7-4d39-a919-bedfe4daf24c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:10.670325 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ef6d687-91e7-4d39-a919-bedfe4daf24c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:10.874905 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7e800212-022d-4338-832b-e41660e69d33 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:10.890167 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e800212-022d-4338-832b-e41660e69d33 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:10.892249 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e800212-022d-4338-832b-e41660e69d33 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:10.892249 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e800212-022d-4338-832b-e41660e69d33 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:11.000801 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7e800212-022d-4338-832b-e41660e69d33 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Going to try to stop instance {{(pid=127706) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 23:53:11.016939 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0ef6d687-91e7-4d39-a919-bedfe4daf24c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:11.048733 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0ef6d687-91e7-4d39-a919-bedfe4daf24c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1210 microversion: 2.1 time: 0.392436 Aug 29 23:53:11.069156 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 124/244] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:10 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1210 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:11.326366 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7e800212-022d-4338-832b-e41660e69d33 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/action" status: 202 len: 0 microversion: 2.1 time: 0.452996 Aug 29 23:53:11.326366 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 121/245] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:53:10 2022] POST /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:53:11.334728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f65aa2cd-9ed8-493e-b978-2269c19c7c5a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:11.335782 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f65aa2cd-9ed8-493e-b978-2269c19c7c5a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:11.349536 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f65aa2cd-9ed8-493e-b978-2269c19c7c5a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:11.350812 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f65aa2cd-9ed8-493e-b978-2269c19c7c5a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:11.352044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f65aa2cd-9ed8-493e-b978-2269c19c7c5a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:11.353711 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f65aa2cd-9ed8-493e-b978-2269c19c7c5a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:11.354888 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f65aa2cd-9ed8-493e-b978-2269c19c7c5a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:11.366269 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f65aa2cd-9ed8-493e-b978-2269c19c7c5a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:11.886268 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f65aa2cd-9ed8-493e-b978-2269c19c7c5a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:11.902666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f65aa2cd-9ed8-493e-b978-2269c19c7c5a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.573481 Aug 29 23:53:11.903670 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 125/246] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:11 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:12.027442 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f6ebfc6f-3c44-40cf-b20c-efb6b6575584 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'create', calling method: .version_select at 0x7fabbdf8aee0>, body: {"keypair": {"name": "tempest-keypair-644173455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIjmZ7jMGYivGyC4ullUGuVizO/jih30wneB18gSkdklKdsX7V2qWBTdNqkd6J+jshTRd4VFpiiYc6yWzE//8cmlwNkSMfCaIkwJHyvW2/rVHrpoMJN/Lk1ilsosN9arQ=="}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:12.049357 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-f6ebfc6f-3c44-40cf-b20c-efb6b6575584 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Getting quotas for project cb38bc3ae5c14e4c8385809d84573600. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:53:12.058818 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-f6ebfc6f-3c44-40cf-b20c-efb6b6575584 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Getting quotas for user 734d44438bfb4a79a68aa6705e49b1e9 and project cb38bc3ae5c14e4c8385809d84573600. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:53:12.088312 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-cfeaf5be-adc7-408a-a2c2-06b832898b56 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:12.088312 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-cfeaf5be-adc7-408a-a2c2-06b832898b56 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:12.099725 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cfeaf5be-adc7-408a-a2c2-06b832898b56 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.103900 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cfeaf5be-adc7-408a-a2c2-06b832898b56 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.104363 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cfeaf5be-adc7-408a-a2c2-06b832898b56 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:12.105112 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cfeaf5be-adc7-408a-a2c2-06b832898b56 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.105702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cfeaf5be-adc7-408a-a2c2-06b832898b56 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.106214 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cfeaf5be-adc7-408a-a2c2-06b832898b56 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:12.239845 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f6ebfc6f-3c44-40cf-b20c-efb6b6575584 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.210923 Aug 29 23:53:12.239845 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 122/247] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Aug 29 23:53:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:12.289695 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-cfeaf5be-adc7-408a-a2c2-06b832898b56 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:12.304444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-cfeaf5be-adc7-408a-a2c2-06b832898b56 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1274 microversion: 2.1 time: 0.224230 Aug 29 23:53:12.306442 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 126/248] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:12 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1274 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:12.948803 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3af35072-eb54-49ad-894f-e2daf6f38431 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:12.949557 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3af35072-eb54-49ad-894f-e2daf6f38431 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:12.957896 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3af35072-eb54-49ad-894f-e2daf6f38431 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.958559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3af35072-eb54-49ad-894f-e2daf6f38431 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.959188 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3af35072-eb54-49ad-894f-e2daf6f38431 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:12.960160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3af35072-eb54-49ad-894f-e2daf6f38431 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:12.960914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3af35072-eb54-49ad-894f-e2daf6f38431 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:12.961498 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3af35072-eb54-49ad-894f-e2daf6f38431 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.259571 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3af35072-eb54-49ad-894f-e2daf6f38431 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:13.277949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3af35072-eb54-49ad-894f-e2daf6f38431 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.333157 Aug 29 23:53:13.290497 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 123/249] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:12 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:13.330377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8aad0359-6656-4dda-8798-e6df698f1f60 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:13.331127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8aad0359-6656-4dda-8798-e6df698f1f60 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:13.347836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aad0359-6656-4dda-8798-e6df698f1f60 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:13.348666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aad0359-6656-4dda-8798-e6df698f1f60 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:13.349265 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aad0359-6656-4dda-8798-e6df698f1f60 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.350194 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aad0359-6656-4dda-8798-e6df698f1f60 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:13.354335 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aad0359-6656-4dda-8798-e6df698f1f60 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:13.354681 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8aad0359-6656-4dda-8798-e6df698f1f60 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:13.491540 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8aad0359-6656-4dda-8798-e6df698f1f60 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:13.513971 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8aad0359-6656-4dda-8798-e6df698f1f60 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1272 microversion: 2.1 time: 0.187028 Aug 29 23:53:13.522634 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 127/250] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:13 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:14.313764 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-14c7a216-acf2-481c-9648-26307f48467b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:14.315003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-14c7a216-acf2-481c-9648-26307f48467b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:14.323865 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14c7a216-acf2-481c-9648-26307f48467b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.325410 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14c7a216-acf2-481c-9648-26307f48467b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.326139 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14c7a216-acf2-481c-9648-26307f48467b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.327713 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14c7a216-acf2-481c-9648-26307f48467b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.328438 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14c7a216-acf2-481c-9648-26307f48467b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.329078 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14c7a216-acf2-481c-9648-26307f48467b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.443667 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-384b763e-8dfb-453d-ba1e-1abdab189a85 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:14.446050 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-384b763e-8dfb-453d-ba1e-1abdab189a85 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:14.460672 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-384b763e-8dfb-453d-ba1e-1abdab189a85 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.461564 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-384b763e-8dfb-453d-ba1e-1abdab189a85 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.463463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-384b763e-8dfb-453d-ba1e-1abdab189a85 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.464822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-384b763e-8dfb-453d-ba1e-1abdab189a85 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.465860 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-384b763e-8dfb-453d-ba1e-1abdab189a85 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.466653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-384b763e-8dfb-453d-ba1e-1abdab189a85 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.504207 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-384b763e-8dfb-453d-ba1e-1abdab189a85 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/ips" status: 200 len: 150 microversion: 2.1 time: 0.069686 Aug 29 23:53:14.505206 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 128/251] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Aug 29 23:53:14 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/ips => generated 150 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:14.556494 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0382b788-b440-42c4-8704-7dcc9cd0ab8b tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:14.558014 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0382b788-b440-42c4-8704-7dcc9cd0ab8b tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:14.581814 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0382b788-b440-42c4-8704-7dcc9cd0ab8b tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.583396 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0382b788-b440-42c4-8704-7dcc9cd0ab8b tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.584550 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0382b788-b440-42c4-8704-7dcc9cd0ab8b tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.586162 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0382b788-b440-42c4-8704-7dcc9cd0ab8b tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:14.587740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0382b788-b440-42c4-8704-7dcc9cd0ab8b tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:14.589655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0382b788-b440-42c4-8704-7dcc9cd0ab8b tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:14.604821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-14c7a216-acf2-481c-9648-26307f48467b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:14.623102 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-14c7a216-acf2-481c-9648-26307f48467b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.314342 Aug 29 23:53:14.624095 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 124/252] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:14 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:15.062638 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0382b788-b440-42c4-8704-7dcc9cd0ab8b tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:15.080826 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0382b788-b440-42c4-8704-7dcc9cd0ab8b tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.532921 Aug 29 23:53:15.098566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 129/253] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:14 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:15.140376 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-386fe8bb-6e3e-4ac5-a36d-bee62d602fce req-aa67afaf-9783-45d7-b0d0-bdbe64a5066f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98048107-6035-440d-b29e-4b51e50e671b", "tag": "d1602be7-c422-4463-af42-5384d69d2c62"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:15.164390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-386fe8bb-6e3e-4ac5-a36d-bee62d602fce req-aa67afaf-9783-45d7-b0d0-bdbe64a5066f service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:15.165011 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-386fe8bb-6e3e-4ac5-a36d-bee62d602fce req-aa67afaf-9783-45d7-b0d0-bdbe64a5066f service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:15.165739 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-386fe8bb-6e3e-4ac5-a36d-bee62d602fce req-aa67afaf-9783-45d7-b0d0-bdbe64a5066f service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:15.193271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-386fe8bb-6e3e-4ac5-a36d-bee62d602fce req-aa67afaf-9783-45d7-b0d0-bdbe64a5066f service nova] Creating event network-changed:d1602be7-c422-4463-af42-5384d69d2c62 for instance 98048107-6035-440d-b29e-4b51e50e671b on hv-cinder-85427 Aug 29 23:53:15.217141 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-386fe8bb-6e3e-4ac5-a36d-bee62d602fce req-aa67afaf-9783-45d7-b0d0-bdbe64a5066f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081509 Aug 29 23:53:15.222619 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 125/254] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:15.452444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f7a8f235-22f9-469c-b2c8-b20a78983d9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:15.453650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f7a8f235-22f9-469c-b2c8-b20a78983d9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:15.461211 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f7a8f235-22f9-469c-b2c8-b20a78983d9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:15.461995 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f7a8f235-22f9-469c-b2c8-b20a78983d9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:15.462616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f7a8f235-22f9-469c-b2c8-b20a78983d9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:15.463526 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f7a8f235-22f9-469c-b2c8-b20a78983d9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:15.464148 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f7a8f235-22f9-469c-b2c8-b20a78983d9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:15.464772 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f7a8f235-22f9-469c-b2c8-b20a78983d9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:15.492294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f7a8f235-22f9-469c-b2c8-b20a78983d9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/ips" status: 200 len: 151 microversion: 2.20 time: 0.044628 Aug 29 23:53:15.493173 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 130/255] 10.222.0.58 () {60 vars in 1289 bytes} [Mon Aug 29 23:53:15 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:53:15.662102 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8331ad8c-cf1f-4a43-9f40-3a0ae03e63ff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:15.666962 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8331ad8c-cf1f-4a43-9f40-3a0ae03e63ff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:15.695293 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8331ad8c-cf1f-4a43-9f40-3a0ae03e63ff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:15.696527 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8331ad8c-cf1f-4a43-9f40-3a0ae03e63ff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:15.697746 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8331ad8c-cf1f-4a43-9f40-3a0ae03e63ff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:15.702630 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8331ad8c-cf1f-4a43-9f40-3a0ae03e63ff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:15.703969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8331ad8c-cf1f-4a43-9f40-3a0ae03e63ff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:15.706101 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8331ad8c-cf1f-4a43-9f40-3a0ae03e63ff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.128602 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-074d3882-9065-42c1-95d6-2452f29cab46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:16.128602 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-074d3882-9065-42c1-95d6-2452f29cab46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:16.142932 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-074d3882-9065-42c1-95d6-2452f29cab46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.143744 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-074d3882-9065-42c1-95d6-2452f29cab46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.144974 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-074d3882-9065-42c1-95d6-2452f29cab46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.146770 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-074d3882-9065-42c1-95d6-2452f29cab46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:16.147782 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-074d3882-9065-42c1-95d6-2452f29cab46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:16.148807 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-074d3882-9065-42c1-95d6-2452f29cab46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:16.313752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8331ad8c-cf1f-4a43-9f40-3a0ae03e63ff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:16.350186 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8331ad8c-cf1f-4a43-9f40-3a0ae03e63ff tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.707525 Aug 29 23:53:16.358648 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 126/256] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:15 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:16.494490 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-074d3882-9065-42c1-95d6-2452f29cab46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:16.507334 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-074d3882-9065-42c1-95d6-2452f29cab46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.389315 Aug 29 23:53:16.507334 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 131/257] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:16 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:17.095462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-663033072", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f41e94be-340b-4555-8a1d-79b9b3c4ac59"}], "security_groups": [{"name": "tempest-securitygroup--355225505"}], "key_name": "tempest-keypair-644173455", "user_data": "}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:17.245466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] validate_networks() for [('f41e94be-340b-4555-8a1d-79b9b3c4ac59', None, None, None, None, None)] {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:53:17.379585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a59a077f-93d0-4687-83dd-62997190e3f6 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:17.385062 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a59a077f-93d0-4687-83dd-62997190e3f6 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:17.404754 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a59a077f-93d0-4687-83dd-62997190e3f6 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:17.408180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a59a077f-93d0-4687-83dd-62997190e3f6 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:17.412292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a59a077f-93d0-4687-83dd-62997190e3f6 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:17.413776 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a59a077f-93d0-4687-83dd-62997190e3f6 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:17.432351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a59a077f-93d0-4687-83dd-62997190e3f6 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:17.432351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a59a077f-93d0-4687-83dd-62997190e3f6 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:17.474066 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:17.994688 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a59a077f-93d0-4687-83dd-62997190e3f6 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:18.007616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a59a077f-93d0-4687-83dd-62997190e3f6 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.635195 Aug 29 23:53:18.012464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 132/258] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:17 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:18.031768 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-016f84bf-958a-4389-a249-5ea578cff74c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:18.032280 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-016f84bf-958a-4389-a249-5ea578cff74c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:18.051008 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:18.058337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-016f84bf-958a-4389-a249-5ea578cff74c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:18.059108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-016f84bf-958a-4389-a249-5ea578cff74c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:18.059841 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-016f84bf-958a-4389-a249-5ea578cff74c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:18.060650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-016f84bf-958a-4389-a249-5ea578cff74c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:18.061102 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-016f84bf-958a-4389-a249-5ea578cff74c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:18.061524 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-016f84bf-958a-4389-a249-5ea578cff74c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:18.211300 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:53:18.213997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:53:18.222899 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:53:18.224191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:53:18.226564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:53:18.275410 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:18.283596 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:18.284602 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:18.288920 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:18.289601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:18.290169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:18.317621 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Getting quotas for project cb38bc3ae5c14e4c8385809d84573600. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:53:18.323464 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Getting quotas for user 734d44438bfb4a79a68aa6705e49b1e9 and project cb38bc3ae5c14e4c8385809d84573600. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:53:18.338477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:53:18.341346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:53:18.371824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-016f84bf-958a-4389-a249-5ea578cff74c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:18.388336 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-016f84bf-958a-4389-a249-5ea578cff74c tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.361161 Aug 29 23:53:18.414618 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 133/259] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:18 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:18.532919 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-50822dd5-c642-4f6a-a8fe-cb9dc9738e75 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.443433 Aug 29 23:53:18.533803 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 127/260] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:53:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:53:18.553841 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-32df8ddf-df67-4b6b-9870-8ad72737088c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:18.557578 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-32df8ddf-df67-4b6b-9870-8ad72737088c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:18.741594 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-32df8ddf-df67-4b6b-9870-8ad72737088c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:18.776483 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-32df8ddf-df67-4b6b-9870-8ad72737088c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1244 microversion: 2.1 time: 0.231358 Aug 29 23:53:18.783666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 134/261] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:18 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1244 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:19.038971 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-16e41bf8-b6c8-49e7-9f57-95d241a06a73 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.039959 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-16e41bf8-b6c8-49e7-9f57-95d241a06a73 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:19.049339 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16e41bf8-b6c8-49e7-9f57-95d241a06a73 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.050505 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16e41bf8-b6c8-49e7-9f57-95d241a06a73 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.051513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16e41bf8-b6c8-49e7-9f57-95d241a06a73 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.053342 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16e41bf8-b6c8-49e7-9f57-95d241a06a73 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.054091 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16e41bf8-b6c8-49e7-9f57-95d241a06a73 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.055124 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16e41bf8-b6c8-49e7-9f57-95d241a06a73 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.304208 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-16e41bf8-b6c8-49e7-9f57-95d241a06a73 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:19.387990 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-16e41bf8-b6c8-49e7-9f57-95d241a06a73 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.355875 Aug 29 23:53:19.388742 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 128/262] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:19.436111 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8c1ef942-23b5-4ea8-9827-d54399c546e7 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.436901 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8c1ef942-23b5-4ea8-9827-d54399c546e7 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:19.449742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c1ef942-23b5-4ea8-9827-d54399c546e7 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.450237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c1ef942-23b5-4ea8-9827-d54399c546e7 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.451019 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c1ef942-23b5-4ea8-9827-d54399c546e7 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.451842 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c1ef942-23b5-4ea8-9827-d54399c546e7 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.452599 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c1ef942-23b5-4ea8-9827-d54399c546e7 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.453031 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c1ef942-23b5-4ea8-9827-d54399c546e7 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.518967 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8a24724e-fb2e-4f5b-a996-9286e83e981f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9935689c-45c6-4768-948f-69b24cd6cc87"}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:19.521704 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8a24724e-fb2e-4f5b-a996-9286e83e981f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:19.553001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a24724e-fb2e-4f5b-a996-9286e83e981f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.558289 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a24724e-fb2e-4f5b-a996-9286e83e981f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.559439 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a24724e-fb2e-4f5b-a996-9286e83e981f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.560320 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a24724e-fb2e-4f5b-a996-9286e83e981f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:19.562269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a24724e-fb2e-4f5b-a996-9286e83e981f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:19.562269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8a24724e-fb2e-4f5b-a996-9286e83e981f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:19.905542 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8c1ef942-23b5-4ea8-9827-d54399c546e7 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:19.926897 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8c1ef942-23b5-4ea8-9827-d54399c546e7 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.492359 Aug 29 23:53:19.928110 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 135/263] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:19.968781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1c3ec39c-5d8e-4d61-ba2a-63a5738895f7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:19.970566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1c3ec39c-5d8e-4d61-ba2a-63a5738895f7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:20.318351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1c3ec39c-5d8e-4d61-ba2a-63a5738895f7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:20.332189 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1c3ec39c-5d8e-4d61-ba2a-63a5738895f7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1244 microversion: 2.1 time: 0.401275 Aug 29 23:53:20.334011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 136/264] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:19 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1244 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:20.425772 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-34ed9a09-9e5a-4fa7-8b8d-d6ee6150b046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:20.426453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-34ed9a09-9e5a-4fa7-8b8d-d6ee6150b046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:20.441834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34ed9a09-9e5a-4fa7-8b8d-d6ee6150b046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.445130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34ed9a09-9e5a-4fa7-8b8d-d6ee6150b046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.454383 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34ed9a09-9e5a-4fa7-8b8d-d6ee6150b046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.456233 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34ed9a09-9e5a-4fa7-8b8d-d6ee6150b046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.460236 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34ed9a09-9e5a-4fa7-8b8d-d6ee6150b046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.461043 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-34ed9a09-9e5a-4fa7-8b8d-d6ee6150b046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.640893 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8a24724e-fb2e-4f5b-a996-9286e83e981f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.124748 Aug 29 23:53:20.642166 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 129/265] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:53:19 2022] POST /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments => generated 194 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:20.651240 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f0a82203-dce4-4ce8-a501-8d2811caa5fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:20.652787 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f0a82203-dce4-4ce8-a501-8d2811caa5fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:20.666353 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0a82203-dce4-4ce8-a501-8d2811caa5fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.668759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0a82203-dce4-4ce8-a501-8d2811caa5fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.669923 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0a82203-dce4-4ce8-a501-8d2811caa5fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.671471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0a82203-dce4-4ce8-a501-8d2811caa5fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:20.672183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0a82203-dce4-4ce8-a501-8d2811caa5fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:20.672717 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0a82203-dce4-4ce8-a501-8d2811caa5fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:20.709939 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-f0a82203-dce4-4ce8-a501-8d2811caa5fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lazy-loading 'flavor' on Instance uuid 781bf4fc-f6e6-4efc-b757-5888339b6b3c {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:53:20.836082 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-34ed9a09-9e5a-4fa7-8b8d-d6ee6150b046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:20.868989 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-34ed9a09-9e5a-4fa7-8b8d-d6ee6150b046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.448372 Aug 29 23:53:20.869597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 137/266] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:20 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:20.971212 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3ff2c822-20ad-4d6e-9544-ed65f2c1d37a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:20.975260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3ff2c822-20ad-4d6e-9544-ed65f2c1d37a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:21.009906 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3ff2c822-20ad-4d6e-9544-ed65f2c1d37a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.013824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3ff2c822-20ad-4d6e-9544-ed65f2c1d37a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.014610 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3ff2c822-20ad-4d6e-9544-ed65f2c1d37a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.018169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3ff2c822-20ad-4d6e-9544-ed65f2c1d37a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.019192 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3ff2c822-20ad-4d6e-9544-ed65f2c1d37a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.020149 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3ff2c822-20ad-4d6e-9544-ed65f2c1d37a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.335210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3ff2c822-20ad-4d6e-9544-ed65f2c1d37a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:21.366935 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3ff2c822-20ad-4d6e-9544-ed65f2c1d37a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.404810 Aug 29 23:53:21.390465 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 138/267] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:20 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:21.390465 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-142e2f09-43c6-45cd-bbe9-1e90694127fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:21.390465 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-142e2f09-43c6-45cd-bbe9-1e90694127fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:21.394897 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-142e2f09-43c6-45cd-bbe9-1e90694127fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.396043 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-142e2f09-43c6-45cd-bbe9-1e90694127fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.397073 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-142e2f09-43c6-45cd-bbe9-1e90694127fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.399563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-142e2f09-43c6-45cd-bbe9-1e90694127fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.400641 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-142e2f09-43c6-45cd-bbe9-1e90694127fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.401592 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-142e2f09-43c6-45cd-bbe9-1e90694127fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.538467 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-142e2f09-43c6-45cd-bbe9-1e90694127fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:21.557274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-142e2f09-43c6-45cd-bbe9-1e90694127fa tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1240 microversion: 2.1 time: 0.181321 Aug 29 23:53:21.559124 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 139/268] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:21 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1240 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:21.635644 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:21.914924 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-470cd196-c1f7-4dea-9517-f9cb937782ea tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:21.915618 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-470cd196-c1f7-4dea-9517-f9cb937782ea tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:21.928688 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470cd196-c1f7-4dea-9517-f9cb937782ea tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.930615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470cd196-c1f7-4dea-9517-f9cb937782ea tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.930615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470cd196-c1f7-4dea-9517-f9cb937782ea tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.930615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470cd196-c1f7-4dea-9517-f9cb937782ea tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.931090 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470cd196-c1f7-4dea-9517-f9cb937782ea tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.931720 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-470cd196-c1f7-4dea-9517-f9cb937782ea tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.934351 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f0a82203-dce4-4ce8-a501-8d2811caa5fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "POST /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/action" status: 202 len: 0 microversion: 2.20 time: 1.289608 Aug 29 23:53:21.935828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 130/269] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Aug 29 23:53:20 2022] POST /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/action => generated 0 bytes in 1293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:53:21.950290 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:21.951446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:21.959250 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.959928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.960471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:21.961319 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:21.961888 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:21.962451 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:22.268280 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-470cd196-c1f7-4dea-9517-f9cb937782ea tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:22.293596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-470cd196-c1f7-4dea-9517-f9cb937782ea tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.392734 Aug 29 23:53:22.302576 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 140/270] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:21 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:22.303651 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:22.318799 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:22.322087 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:22.325085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-73576298-0000-4828-81e1-945fc7b1ca02 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.380692 Aug 29 23:53:22.339198 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 131/271] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:21 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:22.422206 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d5bc0293-1fa8-459d-a381-79d0c7d2ba30 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:22.423723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d5bc0293-1fa8-459d-a381-79d0c7d2ba30 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:22.435747 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5bc0293-1fa8-459d-a381-79d0c7d2ba30 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:22.436255 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5bc0293-1fa8-459d-a381-79d0c7d2ba30 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:22.436899 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5bc0293-1fa8-459d-a381-79d0c7d2ba30 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:22.437720 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5bc0293-1fa8-459d-a381-79d0c7d2ba30 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:22.438307 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5bc0293-1fa8-459d-a381-79d0c7d2ba30 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:22.438926 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5bc0293-1fa8-459d-a381-79d0c7d2ba30 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:22.599891 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2c0e3318-a14f-41fa-9cc9-1eae43200720 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:22.601890 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2c0e3318-a14f-41fa-9cc9-1eae43200720 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:22.619594 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c0e3318-a14f-41fa-9cc9-1eae43200720 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:22.620521 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c0e3318-a14f-41fa-9cc9-1eae43200720 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:22.622763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c0e3318-a14f-41fa-9cc9-1eae43200720 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:22.627394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c0e3318-a14f-41fa-9cc9-1eae43200720 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:22.627394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c0e3318-a14f-41fa-9cc9-1eae43200720 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:22.627394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2c0e3318-a14f-41fa-9cc9-1eae43200720 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:22.645160 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d5bc0293-1fa8-459d-a381-79d0c7d2ba30 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:22.662077 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d5bc0293-1fa8-459d-a381-79d0c7d2ba30 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.246057 Aug 29 23:53:22.663272 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 141/272] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:22 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:22.734171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2c0e3318-a14f-41fa-9cc9-1eae43200720 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:22.743137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2c0e3318-a14f-41fa-9cc9-1eae43200720 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1240 microversion: 2.1 time: 0.164824 Aug 29 23:53:22.744232 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 132/273] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:22 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1240 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:23.318633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ec7fbc81-a231-4dc2-a8b2-daad24653678 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:23.319687 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ec7fbc81-a231-4dc2-a8b2-daad24653678 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:23.329956 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec7fbc81-a231-4dc2-a8b2-daad24653678 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.331569 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec7fbc81-a231-4dc2-a8b2-daad24653678 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.332372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec7fbc81-a231-4dc2-a8b2-daad24653678 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.333694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec7fbc81-a231-4dc2-a8b2-daad24653678 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.334560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec7fbc81-a231-4dc2-a8b2-daad24653678 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.335527 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec7fbc81-a231-4dc2-a8b2-daad24653678 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.367021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:23.367627 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:23.384323 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.384815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.385248 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.385972 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.386599 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.387037 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.649844 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ec7fbc81-a231-4dc2-a8b2-daad24653678 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:23.673654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ec7fbc81-a231-4dc2-a8b2-daad24653678 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.359482 Aug 29 23:53:23.706847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 142/274] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:23 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:23.713177 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1d3014c3-bb4f-4f48-8cd7-25319c0ad723 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:23.713818 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1d3014c3-bb4f-4f48-8cd7-25319c0ad723 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:23.721775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d3014c3-bb4f-4f48-8cd7-25319c0ad723 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.722277 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d3014c3-bb4f-4f48-8cd7-25319c0ad723 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.723052 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d3014c3-bb4f-4f48-8cd7-25319c0ad723 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.723872 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d3014c3-bb4f-4f48-8cd7-25319c0ad723 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.724493 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d3014c3-bb4f-4f48-8cd7-25319c0ad723 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.724986 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d3014c3-bb4f-4f48-8cd7-25319c0ad723 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.819911 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:23.829699 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:23.831674 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:23.833314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-274be19b-066d-4029-82a8-fac40ee86dd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.470359 Aug 29 23:53:23.846560 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 133/275] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:23 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:23.856998 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a81243ef-8e57-4c30-883d-a4e47cf76760 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:23.857967 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a81243ef-8e57-4c30-883d-a4e47cf76760 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:23.865958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a81243ef-8e57-4c30-883d-a4e47cf76760 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.866725 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a81243ef-8e57-4c30-883d-a4e47cf76760 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.867519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a81243ef-8e57-4c30-883d-a4e47cf76760 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.879916 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a81243ef-8e57-4c30-883d-a4e47cf76760 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:23.880844 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a81243ef-8e57-4c30-883d-a4e47cf76760 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:23.881592 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a81243ef-8e57-4c30-883d-a4e47cf76760 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:23.945486 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1d3014c3-bb4f-4f48-8cd7-25319c0ad723 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:23.982814 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1d3014c3-bb4f-4f48-8cd7-25319c0ad723 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.274000 Aug 29 23:53:23.987176 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 143/276] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:23 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:24.037117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a81243ef-8e57-4c30-883d-a4e47cf76760 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:24.055739 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a81243ef-8e57-4c30-883d-a4e47cf76760 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1240 microversion: 2.1 time: 0.213226 Aug 29 23:53:24.056409 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 134/277] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:23 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1240 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:24.724184 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9f83a26b-340b-4a4e-9681-7d6e4be658f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:24.726701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9f83a26b-340b-4a4e-9681-7d6e4be658f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:24.750781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9f83a26b-340b-4a4e-9681-7d6e4be658f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:24.751670 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9f83a26b-340b-4a4e-9681-7d6e4be658f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:24.754612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9f83a26b-340b-4a4e-9681-7d6e4be658f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:24.756502 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9f83a26b-340b-4a4e-9681-7d6e4be658f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:24.774400 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9f83a26b-340b-4a4e-9681-7d6e4be658f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:24.778156 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9f83a26b-340b-4a4e-9681-7d6e4be658f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:24.873902 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:24.891916 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:24.907220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:24.908258 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:24.914318 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:24.914318 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:24.914318 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:24.914318 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:25.270389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9f83a26b-340b-4a4e-9681-7d6e4be658f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:25.286646 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9f83a26b-340b-4a4e-9681-7d6e4be658f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.575944 Aug 29 23:53:25.287605 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 144/278] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:24 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:25.294622 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9852b9af-8ed1-47e4-a43e-efbda7b2799f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:25.296399 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9852b9af-8ed1-47e4-a43e-efbda7b2799f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:25.327879 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9852b9af-8ed1-47e4-a43e-efbda7b2799f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:25.334028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9852b9af-8ed1-47e4-a43e-efbda7b2799f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:25.334859 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9852b9af-8ed1-47e4-a43e-efbda7b2799f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:25.336389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9852b9af-8ed1-47e4-a43e-efbda7b2799f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:25.337247 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9852b9af-8ed1-47e4-a43e-efbda7b2799f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:25.340718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9852b9af-8ed1-47e4-a43e-efbda7b2799f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:25.379599 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:25.411398 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:25.418601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:25.425102 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-de27d0a0-46d3-4d25-8704-4b5c9725b1eb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.567641 Aug 29 23:53:25.428936 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 135/279] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:24 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:25.447890 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7bf68e02-ad80-4e2d-9ef9-5aa5716ec664 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:25.450860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7bf68e02-ad80-4e2d-9ef9-5aa5716ec664 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:25.463885 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bf68e02-ad80-4e2d-9ef9-5aa5716ec664 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:25.465165 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bf68e02-ad80-4e2d-9ef9-5aa5716ec664 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:25.465622 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bf68e02-ad80-4e2d-9ef9-5aa5716ec664 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:25.467835 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bf68e02-ad80-4e2d-9ef9-5aa5716ec664 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:25.468321 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bf68e02-ad80-4e2d-9ef9-5aa5716ec664 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:25.473986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7bf68e02-ad80-4e2d-9ef9-5aa5716ec664 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:25.693709 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7bf68e02-ad80-4e2d-9ef9-5aa5716ec664 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:25.707636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7bf68e02-ad80-4e2d-9ef9-5aa5716ec664 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1296 microversion: 2.1 time: 0.274864 Aug 29 23:53:25.710497 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 136/280] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:25 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1296 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:25.718933 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9852b9af-8ed1-47e4-a43e-efbda7b2799f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:25.740518 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9852b9af-8ed1-47e4-a43e-efbda7b2799f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.451251 Aug 29 23:53:25.742405 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 145/281] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:25 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:26.311018 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-338aff28-d984-4840-85d2-f1373b61786f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:26.311926 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-338aff28-d984-4840-85d2-f1373b61786f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:26.335877 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-338aff28-d984-4840-85d2-f1373b61786f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:26.336748 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-338aff28-d984-4840-85d2-f1373b61786f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:26.337563 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-338aff28-d984-4840-85d2-f1373b61786f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:26.338915 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-338aff28-d984-4840-85d2-f1373b61786f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:26.340504 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-338aff28-d984-4840-85d2-f1373b61786f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:26.341300 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-338aff28-d984-4840-85d2-f1373b61786f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:26.485034 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:26.486129 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:26.497315 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:26.498172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:26.499030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:26.500287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:26.501130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:26.502525 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:26.635163 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-338aff28-d984-4840-85d2-f1373b61786f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:26.653565 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-338aff28-d984-4840-85d2-f1373b61786f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.342029 Aug 29 23:53:26.654659 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 137/282] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:26 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:26.746217 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f5f3fecd-9bf4-4135-a2ca-78518bd883bc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:26.748492 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f5f3fecd-9bf4-4135-a2ca-78518bd883bc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:26.768915 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5f3fecd-9bf4-4135-a2ca-78518bd883bc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:26.771864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5f3fecd-9bf4-4135-a2ca-78518bd883bc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:26.771864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5f3fecd-9bf4-4135-a2ca-78518bd883bc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:26.772799 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5f3fecd-9bf4-4135-a2ca-78518bd883bc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:26.774028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5f3fecd-9bf4-4135-a2ca-78518bd883bc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:26.775486 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5f3fecd-9bf4-4135-a2ca-78518bd883bc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:26.902738 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:26.909393 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f5f3fecd-9bf4-4135-a2ca-78518bd883bc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:26.919652 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:26.922722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:26.925260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-aeb754fe-bb32-4817-a523-f67062f813bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.447738 Aug 29 23:53:26.926462 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 146/283] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:26 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:26.944920 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f5f3fecd-9bf4-4135-a2ca-78518bd883bc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1304 microversion: 2.1 time: 0.214566 Aug 29 23:53:26.946564 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-271a7999-56b5-41f5-a74f-44bac2f20ae9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:26.948278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-271a7999-56b5-41f5-a74f-44bac2f20ae9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:26.949365 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 138/284] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:26 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1304 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:26.963679 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-271a7999-56b5-41f5-a74f-44bac2f20ae9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:26.965819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-271a7999-56b5-41f5-a74f-44bac2f20ae9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:26.967077 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-271a7999-56b5-41f5-a74f-44bac2f20ae9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:26.968701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-271a7999-56b5-41f5-a74f-44bac2f20ae9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:26.969894 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-271a7999-56b5-41f5-a74f-44bac2f20ae9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:26.971477 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-271a7999-56b5-41f5-a74f-44bac2f20ae9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:27.264469 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-271a7999-56b5-41f5-a74f-44bac2f20ae9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:27.284698 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-271a7999-56b5-41f5-a74f-44bac2f20ae9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.355958 Aug 29 23:53:27.299594 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 147/285] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:26 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:27.679700 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ddfb9e67-58a9-49c9-a92f-7e0ec15800f3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:27.680371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ddfb9e67-58a9-49c9-a92f-7e0ec15800f3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:27.686797 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddfb9e67-58a9-49c9-a92f-7e0ec15800f3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:27.687278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddfb9e67-58a9-49c9-a92f-7e0ec15800f3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:27.687708 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddfb9e67-58a9-49c9-a92f-7e0ec15800f3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:27.688650 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddfb9e67-58a9-49c9-a92f-7e0ec15800f3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:27.689107 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddfb9e67-58a9-49c9-a92f-7e0ec15800f3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:27.690274 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddfb9e67-58a9-49c9-a92f-7e0ec15800f3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:27.877745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ddfb9e67-58a9-49c9-a92f-7e0ec15800f3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:27.891664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ddfb9e67-58a9-49c9-a92f-7e0ec15800f3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.215744 Aug 29 23:53:27.893120 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 139/286] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:27 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:27.982735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:27.982735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:27.994062 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-782bfad4-5d5c-4479-9973-87c46e1d4d3b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:27.995230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-782bfad4-5d5c-4479-9973-87c46e1d4d3b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:27.998704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.006246 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.006246 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.006246 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.006246 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.006633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.006750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-782bfad4-5d5c-4479-9973-87c46e1d4d3b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.006750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-782bfad4-5d5c-4479-9973-87c46e1d4d3b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.006750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-782bfad4-5d5c-4479-9973-87c46e1d4d3b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.006750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-782bfad4-5d5c-4479-9973-87c46e1d4d3b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.007073 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-782bfad4-5d5c-4479-9973-87c46e1d4d3b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.007073 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-782bfad4-5d5c-4479-9973-87c46e1d4d3b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.093617 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-782bfad4-5d5c-4479-9973-87c46e1d4d3b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:28.104593 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-782bfad4-5d5c-4479-9973-87c46e1d4d3b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1304 microversion: 2.1 time: 0.115763 Aug 29 23:53:28.119119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 140/287] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:27 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:28.292840 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:28.312804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:28.315908 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:28.317420 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-538dbbc6-3d47-4891-a59e-decb6fd9267d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:28.318024 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-538dbbc6-3d47-4891-a59e-decb6fd9267d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:28.320527 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:28.325238 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3eddc70e-6757-46fb-a5e3-344f2297f4ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.356330 Aug 29 23:53:28.326576 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 148/288] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:27 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:28.341573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=10 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:28.349614 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-538dbbc6-3d47-4891-a59e-decb6fd9267d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.350341 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-538dbbc6-3d47-4891-a59e-decb6fd9267d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.350947 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-538dbbc6-3d47-4891-a59e-decb6fd9267d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.352634 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-538dbbc6-3d47-4891-a59e-decb6fd9267d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.353264 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-538dbbc6-3d47-4891-a59e-decb6fd9267d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.353871 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-538dbbc6-3d47-4891-a59e-decb6fd9267d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.629990 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-538dbbc6-3d47-4891-a59e-decb6fd9267d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:28.638181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-2608af1c-b939-43b5-96ba-389df17afeee req-46c14f65-c133-40bb-b1c0-a2aed26579d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98048107-6035-440d-b29e-4b51e50e671b", "name": "network-vif-plugged", "status": "completed", "tag": "d1602be7-c422-4463-af42-5384d69d2c62"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:28.650315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-538dbbc6-3d47-4891-a59e-decb6fd9267d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.336477 Aug 29 23:53:28.651733 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2608af1c-b939-43b5-96ba-389df17afeee req-46c14f65-c133-40bb-b1c0-a2aed26579d7 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.652576 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2608af1c-b939-43b5-96ba-389df17afeee req-46c14f65-c133-40bb-b1c0-a2aed26579d7 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.653258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2608af1c-b939-43b5-96ba-389df17afeee req-46c14f65-c133-40bb-b1c0-a2aed26579d7 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.653741 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 141/289] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:28 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:28.674993 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-2608af1c-b939-43b5-96ba-389df17afeee req-46c14f65-c133-40bb-b1c0-a2aed26579d7 service nova] Creating event network-vif-plugged:d1602be7-c422-4463-af42-5384d69d2c62 for instance 98048107-6035-440d-b29e-4b51e50e671b on hv-cinder-85427 Aug 29 23:53:28.681689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-2608af1c-b939-43b5-96ba-389df17afeee req-46c14f65-c133-40bb-b1c0-a2aed26579d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051321 Aug 29 23:53:28.684524 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 149/290] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:28.916259 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ddc80186-98e9-4c02-a45f-2943b4b4ff67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:28.916927 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ddc80186-98e9-4c02-a45f-2943b4b4ff67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:28.935525 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddc80186-98e9-4c02-a45f-2943b4b4ff67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.936553 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddc80186-98e9-4c02-a45f-2943b4b4ff67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.937823 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddc80186-98e9-4c02-a45f-2943b4b4ff67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:28.938949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddc80186-98e9-4c02-a45f-2943b4b4ff67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:28.939683 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddc80186-98e9-4c02-a45f-2943b4b4ff67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:28.940299 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddc80186-98e9-4c02-a45f-2943b4b4ff67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:29.147150 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3a32ed71-1f69-4423-b491-b8a3eb62ad69 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:29.150414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3a32ed71-1f69-4423-b491-b8a3eb62ad69 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:29.173357 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3a32ed71-1f69-4423-b491-b8a3eb62ad69 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:29.175238 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3a32ed71-1f69-4423-b491-b8a3eb62ad69 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:29.175689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3a32ed71-1f69-4423-b491-b8a3eb62ad69 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:29.176578 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3a32ed71-1f69-4423-b491-b8a3eb62ad69 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:29.177029 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3a32ed71-1f69-4423-b491-b8a3eb62ad69 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:29.177914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3a32ed71-1f69-4423-b491-b8a3eb62ad69 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:29.436222 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3a32ed71-1f69-4423-b491-b8a3eb62ad69 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:29.455123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3a32ed71-1f69-4423-b491-b8a3eb62ad69 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1304 microversion: 2.1 time: 0.326716 Aug 29 23:53:29.458974 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 150/291] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:29 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1304 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:29.467339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:29.468338 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:29.498970 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:29.500843 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:29.501491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:29.503218 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:29.504210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:29.504796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:29.571201 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ddc80186-98e9-4c02-a45f-2943b4b4ff67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:29.585454 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ddc80186-98e9-4c02-a45f-2943b4b4ff67 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.672978 Aug 29 23:53:29.609552 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 142/292] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:28 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:29.675960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7ebd8dbe-657c-4a7d-bfc8-3e7bcb48fdde tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:29.677036 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7ebd8dbe-657c-4a7d-bfc8-3e7bcb48fdde tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:29.693122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ebd8dbe-657c-4a7d-bfc8-3e7bcb48fdde tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:29.702898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ebd8dbe-657c-4a7d-bfc8-3e7bcb48fdde tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:29.702898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ebd8dbe-657c-4a7d-bfc8-3e7bcb48fdde tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:29.702898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ebd8dbe-657c-4a7d-bfc8-3e7bcb48fdde tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:29.702898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ebd8dbe-657c-4a7d-bfc8-3e7bcb48fdde tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:29.703650 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ebd8dbe-657c-4a7d-bfc8-3e7bcb48fdde tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:30.142057 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:30.145814 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:30.151781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:30.153602 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:30.183591 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-84673a9e-0c63-4927-84e0-973d5541c447 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.693580 Aug 29 23:53:30.184018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 151/293] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:29 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:30.371722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7ebd8dbe-657c-4a7d-bfc8-3e7bcb48fdde tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:30.382685 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7ebd8dbe-657c-4a7d-bfc8-3e7bcb48fdde tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.712302 Aug 29 23:53:30.383211 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 143/294] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:29 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:30.485337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4ef98ab1-5669-472d-8e2f-154640ab67d9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:30.486071 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4ef98ab1-5669-472d-8e2f-154640ab67d9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:30.490148 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=14 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:30.521812 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4ef98ab1-5669-472d-8e2f-154640ab67d9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:30.531109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4ef98ab1-5669-472d-8e2f-154640ab67d9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:30.532646 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4ef98ab1-5669-472d-8e2f-154640ab67d9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:30.535302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4ef98ab1-5669-472d-8e2f-154640ab67d9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:30.537462 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4ef98ab1-5669-472d-8e2f-154640ab67d9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:30.539681 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4ef98ab1-5669-472d-8e2f-154640ab67d9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:30.622197 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a01af98e-189e-446f-8b5a-b273ecfd526e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:30.630339 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a01af98e-189e-446f-8b5a-b273ecfd526e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:30.645620 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a01af98e-189e-446f-8b5a-b273ecfd526e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:30.646138 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a01af98e-189e-446f-8b5a-b273ecfd526e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:30.646698 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a01af98e-189e-446f-8b5a-b273ecfd526e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:30.647421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a01af98e-189e-446f-8b5a-b273ecfd526e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:30.647871 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a01af98e-189e-446f-8b5a-b273ecfd526e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:30.650366 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a01af98e-189e-446f-8b5a-b273ecfd526e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:30.690565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4ef98ab1-5669-472d-8e2f-154640ab67d9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:30.702022 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4ef98ab1-5669-472d-8e2f-154640ab67d9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1302 microversion: 2.1 time: 0.220985 Aug 29 23:53:30.710574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 152/295] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:30 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1302 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:31.065412 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a01af98e-189e-446f-8b5a-b273ecfd526e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:31.080103 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a01af98e-189e-446f-8b5a-b273ecfd526e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.468308 Aug 29 23:53:31.081883 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 144/296] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:30 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:31.212380 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:31.213796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:31.226197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:31.227033 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:31.227136 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:31.227855 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:31.228319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:31.228746 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:31.405851 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-49b744e8-2ff4-427a-b96a-8f20c3c76921 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:31.406722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-49b744e8-2ff4-427a-b96a-8f20c3c76921 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:31.438412 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b744e8-2ff4-427a-b96a-8f20c3c76921 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:31.438412 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b744e8-2ff4-427a-b96a-8f20c3c76921 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:31.450667 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b744e8-2ff4-427a-b96a-8f20c3c76921 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:31.457171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b744e8-2ff4-427a-b96a-8f20c3c76921 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:31.459551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b744e8-2ff4-427a-b96a-8f20c3c76921 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:31.461099 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b744e8-2ff4-427a-b96a-8f20c3c76921 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:31.577140 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:31.592034 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:31.602199 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:31.611756 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4c8d0a4c-e09c-4960-9e1e-c5940ffe0f2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.404068 Aug 29 23:53:31.612479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 153/297] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:31 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:31.727631 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-19c684e5-76da-4ca9-b466-921b0fbc61a4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:31.728599 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-19c684e5-76da-4ca9-b466-921b0fbc61a4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:31.741128 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-19c684e5-76da-4ca9-b466-921b0fbc61a4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:31.743278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-19c684e5-76da-4ca9-b466-921b0fbc61a4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:31.744017 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-19c684e5-76da-4ca9-b466-921b0fbc61a4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:31.750020 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-19c684e5-76da-4ca9-b466-921b0fbc61a4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:31.752203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-19c684e5-76da-4ca9-b466-921b0fbc61a4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:31.753574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-19c684e5-76da-4ca9-b466-921b0fbc61a4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:31.959315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-49b744e8-2ff4-427a-b96a-8f20c3c76921 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:31.978056 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-49b744e8-2ff4-427a-b96a-8f20c3c76921 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1314 microversion: 2.1 time: 0.575905 Aug 29 23:53:31.979323 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 145/298] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:31 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:32.128275 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-bb8ad642-16c3-4215-8596-41896b981726 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:32.133989 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-bb8ad642-16c3-4215-8596-41896b981726 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:32.148416 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb8ad642-16c3-4215-8596-41896b981726 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:32.150172 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb8ad642-16c3-4215-8596-41896b981726 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:32.151267 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb8ad642-16c3-4215-8596-41896b981726 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:32.158238 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb8ad642-16c3-4215-8596-41896b981726 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:32.159768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb8ad642-16c3-4215-8596-41896b981726 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:32.165718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb8ad642-16c3-4215-8596-41896b981726 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:32.457647 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-19c684e5-76da-4ca9-b466-921b0fbc61a4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:32.503549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-19c684e5-76da-4ca9-b466-921b0fbc61a4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1369 microversion: 2.1 time: 0.759512 Aug 29 23:53:32.522931 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 154/299] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:31 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1369 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:32.646230 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:32.647038 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:32.673952 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:32.674612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:32.676115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:32.678334 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:32.679471 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:32.682352 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:32.754919 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bb8ad642-16c3-4215-8596-41896b981726 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:32.775086 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-bb8ad642-16c3-4215-8596-41896b981726 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.657877 Aug 29 23:53:32.776220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 146/300] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:32 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:33.009899 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-601ca138-9bc4-4375-b618-df29b07c781f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:33.012051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-601ca138-9bc4-4375-b618-df29b07c781f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:33.031329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-601ca138-9bc4-4375-b618-df29b07c781f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:33.034714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-601ca138-9bc4-4375-b618-df29b07c781f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:33.036711 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-601ca138-9bc4-4375-b618-df29b07c781f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:33.038525 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-601ca138-9bc4-4375-b618-df29b07c781f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:33.039557 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-601ca138-9bc4-4375-b618-df29b07c781f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:33.041359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-601ca138-9bc4-4375-b618-df29b07c781f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:33.102658 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:33.536134 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:33.552681 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:33.555345 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:33.557131 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e625b2d1-0b50-4b30-8bcc-ff8d3a05aa7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.919358 Aug 29 23:53:33.558909 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 155/301] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:32 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:33.568621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9183e288-d14a-4718-89e6-411dc4533a3c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:33.569876 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9183e288-d14a-4718-89e6-411dc4533a3c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:33.584904 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9183e288-d14a-4718-89e6-411dc4533a3c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:33.586337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9183e288-d14a-4718-89e6-411dc4533a3c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:33.587281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9183e288-d14a-4718-89e6-411dc4533a3c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:33.590180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9183e288-d14a-4718-89e6-411dc4533a3c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:33.591174 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9183e288-d14a-4718-89e6-411dc4533a3c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:33.592647 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9183e288-d14a-4718-89e6-411dc4533a3c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:33.799180 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-601ca138-9bc4-4375-b618-df29b07c781f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:33.813634 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-601ca138-9bc4-4375-b618-df29b07c781f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1498 microversion: 2.1 time: 0.814029 Aug 29 23:53:33.819971 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 147/302] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:32 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1498 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:33.826302 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a3740d1f-d996-40bf-8e89-ad524db3fd9b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:33.829811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a3740d1f-d996-40bf-8e89-ad524db3fd9b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:33.848574 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a3740d1f-d996-40bf-8e89-ad524db3fd9b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:33.849229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a3740d1f-d996-40bf-8e89-ad524db3fd9b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:33.854268 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a3740d1f-d996-40bf-8e89-ad524db3fd9b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:33.854268 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a3740d1f-d996-40bf-8e89-ad524db3fd9b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:33.854268 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a3740d1f-d996-40bf-8e89-ad524db3fd9b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:33.854268 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a3740d1f-d996-40bf-8e89-ad524db3fd9b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:34.028172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9183e288-d14a-4718-89e6-411dc4533a3c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:34.038659 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9183e288-d14a-4718-89e6-411dc4533a3c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1369 microversion: 2.1 time: 0.477565 Aug 29 23:53:34.042658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 156/303] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:33 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1369 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:34.054781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ba20d0b5-700c-4d1f-914c-8c81ef447bfc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: .version_select at 0x7fabbe05c1f0>, body: {"keypair": {"name": "tempest-keypair-1932580553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1ybKB0NeAN8nw3LqEU6G7BcTsgKHQISb5WReWb4LmP5umP/wONp11Ux/tVwc9yVkPIkb3ZjmMUhlzMxTp4OU8RzmQ0GA6Miefx+BlxadIJvi0ZTs1gIS6QTMuHl07w4A=="}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:34.093559 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-ba20d0b5-700c-4d1f-914c-8c81ef447bfc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'key_pairs'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:53:34.116693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-ba20d0b5-700c-4d1f-914c-8c81ef447bfc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for user 34ef7ee27c3948ac9df1ff94ce24618e and project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'key_pairs'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:53:34.120822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:34.249432 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a3740d1f-d996-40bf-8e89-ad524db3fd9b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:34.284036 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a3740d1f-d996-40bf-8e89-ad524db3fd9b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1724 microversion: 2.1 time: 0.465811 Aug 29 23:53:34.303461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 148/304] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:33 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:34.319509 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ba20d0b5-700c-4d1f-914c-8c81ef447bfc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.278930 Aug 29 23:53:34.326987 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 157/305] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Aug 29 23:53:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:34.589875 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:34.591029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:34.603749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:34.604928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:34.605843 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:34.606884 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:34.607501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:34.608123 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:34.610312 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-ab2a3e78-e5a9-46a9-b021-5be87fa87692 req-1268e118-1827-44a5-a3ea-595a1c3ee434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c3a360a-1fe2-45f0-ad59-f9e69381ac28", "tag": "4496c220-d785-47cc-8a05-42c8832bf15c"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:34.630691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-ab2a3e78-e5a9-46a9-b021-5be87fa87692 req-1268e118-1827-44a5-a3ea-595a1c3ee434 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:34.633124 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-ab2a3e78-e5a9-46a9-b021-5be87fa87692 req-1268e118-1827-44a5-a3ea-595a1c3ee434 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:34.633813 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-ab2a3e78-e5a9-46a9-b021-5be87fa87692 req-1268e118-1827-44a5-a3ea-595a1c3ee434 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:34.664884 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-ab2a3e78-e5a9-46a9-b021-5be87fa87692 req-1268e118-1827-44a5-a3ea-595a1c3ee434 service nova] Creating event network-changed:4496c220-d785-47cc-8a05-42c8832bf15c for instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 on hv-cinder-85427 Aug 29 23:53:34.688829 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-ab2a3e78-e5a9-46a9-b021-5be87fa87692 req-1268e118-1827-44a5-a3ea-595a1c3ee434 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078848 Aug 29 23:53:34.690359 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 158/306] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:34.988285 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:35.001051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:35.002588 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:35.003843 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-be858d2b-cd00-42af-8f4d-2055cd3adbcd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.419181 Aug 29 23:53:35.004369 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 149/307] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:34 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:35.085823 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e164abc2-6b2f-4ef4-bdbe-aa01e296f758 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:35.085823 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e164abc2-6b2f-4ef4-bdbe-aa01e296f758 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:35.134988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e164abc2-6b2f-4ef4-bdbe-aa01e296f758 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:35.134988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e164abc2-6b2f-4ef4-bdbe-aa01e296f758 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:35.134988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e164abc2-6b2f-4ef4-bdbe-aa01e296f758 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.134988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e164abc2-6b2f-4ef4-bdbe-aa01e296f758 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:35.136339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e164abc2-6b2f-4ef4-bdbe-aa01e296f758 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:35.136339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e164abc2-6b2f-4ef4-bdbe-aa01e296f758 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.179096 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-84491d6b-fbb9-4f5e-a2c8-fbf89da0f76f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:35.179876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-84491d6b-fbb9-4f5e-a2c8-fbf89da0f76f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:35.187908 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:35.189714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84491d6b-fbb9-4f5e-a2c8-fbf89da0f76f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:35.190389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84491d6b-fbb9-4f5e-a2c8-fbf89da0f76f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:35.191437 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84491d6b-fbb9-4f5e-a2c8-fbf89da0f76f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.192806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84491d6b-fbb9-4f5e-a2c8-fbf89da0f76f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:35.193668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84491d6b-fbb9-4f5e-a2c8-fbf89da0f76f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:35.194302 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84491d6b-fbb9-4f5e-a2c8-fbf89da0f76f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.238964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-84491d6b-fbb9-4f5e-a2c8-fbf89da0f76f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Going to try to terminate instance {{(pid=127706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:53:35.529697 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e164abc2-6b2f-4ef4-bdbe-aa01e296f758 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:35.557066 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e164abc2-6b2f-4ef4-bdbe-aa01e296f758 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1369 microversion: 2.1 time: 0.478210 Aug 29 23:53:35.558254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 159/308] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:35 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1369 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:35.566048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c1351475-ed05-4569-b05e-28bbf8f204ba tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:35.567252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c1351475-ed05-4569-b05e-28bbf8f204ba tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:35.578840 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1351475-ed05-4569-b05e-28bbf8f204ba tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:35.579614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1351475-ed05-4569-b05e-28bbf8f204ba tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:35.580209 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1351475-ed05-4569-b05e-28bbf8f204ba tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.601977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1351475-ed05-4569-b05e-28bbf8f204ba tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:35.601977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1351475-ed05-4569-b05e-28bbf8f204ba tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:35.601977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1351475-ed05-4569-b05e-28bbf8f204ba tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.811764 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-84491d6b-fbb9-4f5e-a2c8-fbf89da0f76f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "DELETE /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 204 len: 0 microversion: 2.1 time: 0.635708 Aug 29 23:53:35.820903 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 150/309] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:53:35 2022] DELETE /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:53:35.830947 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a6965c51-1029-458e-9db6-acf49d6af14a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:35.832582 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a6965c51-1029-458e-9db6-acf49d6af14a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:35.843763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a6965c51-1029-458e-9db6-acf49d6af14a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:35.845076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a6965c51-1029-458e-9db6-acf49d6af14a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:35.846065 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a6965c51-1029-458e-9db6-acf49d6af14a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.846845 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a6965c51-1029-458e-9db6-acf49d6af14a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:35.847350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a6965c51-1029-458e-9db6-acf49d6af14a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:35.847774 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a6965c51-1029-458e-9db6-acf49d6af14a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:35.970525 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c1351475-ed05-4569-b05e-28bbf8f204ba tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:35.988211 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c1351475-ed05-4569-b05e-28bbf8f204ba tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1701 microversion: 2.1 time: 0.428396 Aug 29 23:53:35.989051 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 160/310] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:35 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1701 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:36.018132 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5c8714f6-fa8e-43c8-b7f4-523f7ffa2ba5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:36.029150 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5c8714f6-fa8e-43c8-b7f4-523f7ffa2ba5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.029696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5c8714f6-fa8e-43c8-b7f4-523f7ffa2ba5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.031793 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5c8714f6-fa8e-43c8-b7f4-523f7ffa2ba5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.149857 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-5c8714f6-fa8e-43c8-b7f4-523f7ffa2ba5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Going to try to start instance {{(pid=127705) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 23:53:36.218205 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a6965c51-1029-458e-9db6-acf49d6af14a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:36.240740 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a6965c51-1029-458e-9db6-acf49d6af14a tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1504 microversion: 2.1 time: 0.420971 Aug 29 23:53:36.254490 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 151/311] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:35 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1504 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:36.254490 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:36.254490 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:36.263437 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.270915 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.271826 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.272717 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.273248 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.273747 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.423422 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5c8714f6-fa8e-43c8-b7f4-523f7ffa2ba5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/action" status: 202 len: 0 microversion: 2.1 time: 0.409246 Aug 29 23:53:36.424440 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 161/312] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:53:36 2022] POST /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:53:36.437635 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ae7b2cee-1d3b-483b-9e68-61ebd5c43c37 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:36.445063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ae7b2cee-1d3b-483b-9e68-61ebd5c43c37 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:36.458544 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae7b2cee-1d3b-483b-9e68-61ebd5c43c37 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.459304 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae7b2cee-1d3b-483b-9e68-61ebd5c43c37 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.460236 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae7b2cee-1d3b-483b-9e68-61ebd5c43c37 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.461169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae7b2cee-1d3b-483b-9e68-61ebd5c43c37 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.461788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae7b2cee-1d3b-483b-9e68-61ebd5c43c37 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.462476 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae7b2cee-1d3b-483b-9e68-61ebd5c43c37 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.706838 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:36.741965 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:36.746495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:36.749628 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b7dca606-f7a3-492a-ab42-e9afa852957d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.506133 Aug 29 23:53:36.758912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 152/313] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:36 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:36.769052 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-65adb286-4c07-4259-9565-87fdfea649e6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:36.771103 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ae7b2cee-1d3b-483b-9e68-61ebd5c43c37 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:36.771355 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-65adb286-4c07-4259-9565-87fdfea649e6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:36.789010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65adb286-4c07-4259-9565-87fdfea649e6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.789906 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65adb286-4c07-4259-9565-87fdfea649e6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.790748 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65adb286-4c07-4259-9565-87fdfea649e6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.792365 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65adb286-4c07-4259-9565-87fdfea649e6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:36.792971 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65adb286-4c07-4259-9565-87fdfea649e6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:36.793625 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65adb286-4c07-4259-9565-87fdfea649e6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:36.801760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ae7b2cee-1d3b-483b-9e68-61ebd5c43c37 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1710 microversion: 2.1 time: 0.370883 Aug 29 23:53:36.803055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 162/314] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:36 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1710 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:36.988636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-65adb286-4c07-4259-9565-87fdfea649e6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:37.002641 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-65adb286-4c07-4259-9565-87fdfea649e6 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1369 microversion: 2.1 time: 0.249589 Aug 29 23:53:37.004062 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 153/315] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:36 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1369 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:37.272361 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dfe6871b-9106-4470-9115-7d00870ed270 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:37.277807 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-dfe6871b-9106-4470-9115-7d00870ed270 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:37.296547 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dfe6871b-9106-4470-9115-7d00870ed270 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:37.297089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dfe6871b-9106-4470-9115-7d00870ed270 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:37.297534 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dfe6871b-9106-4470-9115-7d00870ed270 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:37.302574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dfe6871b-9106-4470-9115-7d00870ed270 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:37.303431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dfe6871b-9106-4470-9115-7d00870ed270 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:37.304055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dfe6871b-9106-4470-9115-7d00870ed270 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:37.775529 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:37.777178 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:37.795384 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-dfe6871b-9106-4470-9115-7d00870ed270 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:37.801193 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:37.801994 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:37.811416 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:37.812672 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:37.813359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:37.814003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:37.830073 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-dfe6871b-9106-4470-9115-7d00870ed270 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1504 microversion: 2.1 time: 0.562829 Aug 29 23:53:37.835520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 163/316] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:37 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1504 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:37.843047 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-61208781-3343-4bbf-a731-4f97aed4d9fc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:37.844137 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-61208781-3343-4bbf-a731-4f97aed4d9fc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:37.872785 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-61208781-3343-4bbf-a731-4f97aed4d9fc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:37.879244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-61208781-3343-4bbf-a731-4f97aed4d9fc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:37.879244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-61208781-3343-4bbf-a731-4f97aed4d9fc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:37.879244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-61208781-3343-4bbf-a731-4f97aed4d9fc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:37.879244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-61208781-3343-4bbf-a731-4f97aed4d9fc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:37.880279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-61208781-3343-4bbf-a731-4f97aed4d9fc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:38.346084 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:38.367254 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:38.372197 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:38.372197 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e837f1e6-4b4e-4f10-aba8-e471f08905ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.600063 Aug 29 23:53:38.374631 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 154/317] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:37 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:38.379654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3c032230-7c38-4940-94aa-7245192ca1ed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:38.380322 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3c032230-7c38-4940-94aa-7245192ca1ed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:38.400975 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c032230-7c38-4940-94aa-7245192ca1ed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:38.400975 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c032230-7c38-4940-94aa-7245192ca1ed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:38.406224 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c032230-7c38-4940-94aa-7245192ca1ed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:38.407381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c032230-7c38-4940-94aa-7245192ca1ed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:38.410076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c032230-7c38-4940-94aa-7245192ca1ed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:38.410833 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c032230-7c38-4940-94aa-7245192ca1ed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:38.477604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-61208781-3343-4bbf-a731-4f97aed4d9fc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:38.498285 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-61208781-3343-4bbf-a731-4f97aed4d9fc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1710 microversion: 2.1 time: 0.665299 Aug 29 23:53:38.498919 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 164/318] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:37 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1710 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:38.696296 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3c032230-7c38-4940-94aa-7245192ca1ed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:38.707021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3c032230-7c38-4940-94aa-7245192ca1ed tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1369 microversion: 2.1 time: 0.331211 Aug 29 23:53:38.723016 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 155/319] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:38 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1369 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:38.869066 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-15102edc-404a-4b73-b22b-25ec10061439 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:38.870309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-15102edc-404a-4b73-b22b-25ec10061439 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:38.883069 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15102edc-404a-4b73-b22b-25ec10061439 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:38.883572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15102edc-404a-4b73-b22b-25ec10061439 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:38.884016 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15102edc-404a-4b73-b22b-25ec10061439 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:38.884744 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15102edc-404a-4b73-b22b-25ec10061439 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:38.885202 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15102edc-404a-4b73-b22b-25ec10061439 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:38.893597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15102edc-404a-4b73-b22b-25ec10061439 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:39.066993 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-aa06c7c8-6dab-4ad3-b8d3-116234a128ed req-f2f54e35-31c4-4eb1-97ef-7edade57b77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98048107-6035-440d-b29e-4b51e50e671b", "name": "network-vif-deleted", "tag": "d1602be7-c422-4463-af42-5384d69d2c62"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:39.107066 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-aa06c7c8-6dab-4ad3-b8d3-116234a128ed req-f2f54e35-31c4-4eb1-97ef-7edade57b77d service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:39.107556 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-aa06c7c8-6dab-4ad3-b8d3-116234a128ed req-f2f54e35-31c4-4eb1-97ef-7edade57b77d service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:39.107998 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-aa06c7c8-6dab-4ad3-b8d3-116234a128ed req-f2f54e35-31c4-4eb1-97ef-7edade57b77d service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:39.143850 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-aa06c7c8-6dab-4ad3-b8d3-116234a128ed req-f2f54e35-31c4-4eb1-97ef-7edade57b77d service nova] Creating event network-vif-deleted:d1602be7-c422-4463-af42-5384d69d2c62 for instance 98048107-6035-440d-b29e-4b51e50e671b on hv-cinder-85427 Aug 29 23:53:39.185579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-aa06c7c8-6dab-4ad3-b8d3-116234a128ed req-f2f54e35-31c4-4eb1-97ef-7edade57b77d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120937 Aug 29 23:53:39.185579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 156/320] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:39.263322 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-15102edc-404a-4b73-b22b-25ec10061439 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:39.287279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-15102edc-404a-4b73-b22b-25ec10061439 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1462 microversion: 2.1 time: 0.422283 Aug 29 23:53:39.287907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 165/321] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:38 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1462 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:39.396984 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:39.398102 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:39.425128 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:39.430925 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:39.431691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:39.434586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:39.435355 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:39.439068 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:39.529207 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c0870759-8549-42c4-8b79-a4a799652e15 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:39.531109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c0870759-8549-42c4-8b79-a4a799652e15 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:39.550104 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c0870759-8549-42c4-8b79-a4a799652e15 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:39.553045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c0870759-8549-42c4-8b79-a4a799652e15 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:39.554976 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c0870759-8549-42c4-8b79-a4a799652e15 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:39.556117 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c0870759-8549-42c4-8b79-a4a799652e15 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:39.558476 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c0870759-8549-42c4-8b79-a4a799652e15 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:39.559692 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c0870759-8549-42c4-8b79-a4a799652e15 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:40.411071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:40.420464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c0870759-8549-42c4-8b79-a4a799652e15 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:40.468307 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c0870759-8549-42c4-8b79-a4a799652e15 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1710 microversion: 2.1 time: 0.950770 Aug 29 23:53:40.468964 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 166/322] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:39 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1710 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:40.483466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:40.484307 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-da8511a2-7f12-4fce-b8d7-bff4d60c1a09 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:40.486887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:40.494857 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b6893115-9c20-4e25-b84e-969a5374f5cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 1.102629 Aug 29 23:53:40.652396 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-da8511a2-7f12-4fce-b8d7-bff4d60c1a09 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:40.653843 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 157/323] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:39 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:40.654494 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-da8511a2-7f12-4fce-b8d7-bff4d60c1a09 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:40.654494 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-da8511a2-7f12-4fce-b8d7-bff4d60c1a09 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:40.654494 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-da8511a2-7f12-4fce-b8d7-bff4d60c1a09 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:40.654494 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-da8511a2-7f12-4fce-b8d7-bff4d60c1a09 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:40.655573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-da8511a2-7f12-4fce-b8d7-bff4d60c1a09 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:40.655573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-da8511a2-7f12-4fce-b8d7-bff4d60c1a09 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:40.656203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:40.656203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:40.656203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:40.656203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:40.656564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:40.656564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:40.656564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:40.656564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:40.656830 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:40.656830 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:40.656830 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:40.656830 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lazy-loading 'fault' on Instance uuid 98048107-6035-440d-b29e-4b51e50e671b {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:53:40.834049 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:40.858477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a24c8e17-c31f-46a9-a5ed-b9459813d1b9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 200 len: 1304 microversion: 2.1 time: 0.351556 Aug 29 23:53:40.874958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 158/324] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:40 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 1304 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:40.983300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-da8511a2-7f12-4fce-b8d7-bff4d60c1a09 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:41.006441 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-da8511a2-7f12-4fce-b8d7-bff4d60c1a09 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1369 microversion: 2.1 time: 0.532322 Aug 29 23:53:41.007546 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 167/325] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:40 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1369 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:41.361451 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1396724230", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b596b2d-12e3-47f4-a595-eed3b3358a18"}], "security_groups": [{"name": "tempest-securitygroup--238710086"}], "key_name": "tempest-keypair-1932580553", "user_data": "}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:41.496278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-03c6511a-6c24-4e71-8c50-5d733bd23dd5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:41.496918 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-03c6511a-6c24-4e71-8c50-5d733bd23dd5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:41.507123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03c6511a-6c24-4e71-8c50-5d733bd23dd5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:41.508436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03c6511a-6c24-4e71-8c50-5d733bd23dd5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:41.509067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03c6511a-6c24-4e71-8c50-5d733bd23dd5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:41.522854 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03c6511a-6c24-4e71-8c50-5d733bd23dd5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:41.523945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03c6511a-6c24-4e71-8c50-5d733bd23dd5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:41.524810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03c6511a-6c24-4e71-8c50-5d733bd23dd5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:41.752753 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] validate_networks() for [('9b596b2d-12e3-47f4-a595-eed3b3358a18', None, None, None, None, None)] {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:53:42.509043 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-03c6511a-6c24-4e71-8c50-5d733bd23dd5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:42.551926 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-03c6511a-6c24-4e71-8c50-5d733bd23dd5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1710 microversion: 2.1 time: 1.053738 Aug 29 23:53:42.560103 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 168/326] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:41 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1710 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:42.579077 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:42.585956 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:42.612486 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:42.613328 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:42.614038 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:42.615181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:42.616255 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:42.618684 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:42.622756 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:43.116343 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:43.133005 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:43.134701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:43.136573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d5c4cb39-014a-4230-981a-bc7c0fd97e1e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.574517 Aug 29 23:53:43.137153 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 169/327] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:42 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:43.154140 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:43.155108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 98048107-6035-440d-b29e-4b51e50e671b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:43.165799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:43.167264 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:43.167986 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.181028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:43.198752 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:43.201111 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.248288 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] HTTP exception thrown: Instance 98048107-6035-440d-b29e-4b51e50e671b could not be found. Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Request method failure captured: Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b HTTP/1.1 Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVFgdcESXyYI38m0ugvyRGesz_4BPAVStpYYMbwc3zM2QFzEV6FHlzbFkZ2TZW0zLrNMrbd25sBc1Zvu_DijUhHLS_xhmKtwcRTBgEAa8wIQshPbcWhw-BGfmgZfTVLRNVUblPoiPcn8N0LSDejALQ0o5_aq6vat20l0cWGESUMQ-wQ Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 87299c60c42b43e7bf7e8f92f30ae87d Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-VolumesActionsTest-1258923295 Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:53:43.250281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/87299c60c42b43e7bf7e8f92f30ae87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/87299c60c42b43e7bf7e8f92f30ae87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/87299c60c42b43e7bf7e8f92f30ae87d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_87299c60c42b43e7bf7e8f92f30ae87d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-VolumesActionsTest-1258923295 Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 87299c60c42b43e7bf7e8f92f30ae87d Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-VolumesActionsTest-1258923295 Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-VolumesActionsTest-1258923295-project Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 74d57012e9a04960b6c5dde2243dafbc Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-VolumesActionsTest-1258923295-project Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 98048107-6035-440d-b29e-4b51e50e671b could not be found. Aug 29 23:53:43.251851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '98048107-6035-440d-b29e-4b51e50e671b'} Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98048107-6035-440d-b29e-4b51e50e671b could not be found. Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:53:43.252864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98048107-6035-440d-b29e-4b51e50e671b could not be found. Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98048107-6035-440d-b29e-4b51e50e671b could not be found. Aug 29 23:53:43.254172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:53:43.256222 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Returning 404 to user: Instance 98048107-6035-440d-b29e-4b51e50e671b could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:53:43.257252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-add7cf07-62ff-4f57-947b-39277300b884 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b" status: 404 len: 111 microversion: 2.1 time: 0.114745 Aug 29 23:53:43.258304 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 170/328] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:43 2022] GET /compute/v2.1/servers/98048107-6035-440d-b29e-4b51e50e671b => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:53:43.265073 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-01d22981-f905-4b3f-a069-cb59d7c89fce tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:43.270469 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-01d22981-f905-4b3f-a069-cb59d7c89fce tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:43.284797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01d22981-f905-4b3f-a069-cb59d7c89fce tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:43.284797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01d22981-f905-4b3f-a069-cb59d7c89fce tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:43.284797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01d22981-f905-4b3f-a069-cb59d7c89fce tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.284797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01d22981-f905-4b3f-a069-cb59d7c89fce tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:43.285233 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01d22981-f905-4b3f-a069-cb59d7c89fce tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:43.293162 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01d22981-f905-4b3f-a069-cb59d7c89fce tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.445962 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:53:43.445962 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:53:43.445962 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:53:43.445962 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:53:43.445962 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:53:43.461896 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:43.462573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:43.463799 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.464679 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:43.465260 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:43.465762 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:43.576852 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-01d22981-f905-4b3f-a069-cb59d7c89fce tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:43.592621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-01d22981-f905-4b3f-a069-cb59d7c89fce tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1369 microversion: 2.1 time: 0.332551 Aug 29 23:53:43.608030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:53:43.610761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 171/329] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:43 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1369 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:43.616565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1834070635", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "networks": [{"uuid": "9679b41b-badb-474e-91ed-865a85109ffa"}]}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:43.623116 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for user 34ef7ee27c3948ac9df1ff94ce24618e and project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:53:43.680024 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:53:43.694757 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:53:43.707312 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] validate_networks() for [('9679b41b-badb-474e-91ed-865a85109ffa', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:53:44.006961 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4972d74d-477c-45c8-9a6e-12f305608b77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.652113 Aug 29 23:53:44.009186 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 159/330] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:53:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 2657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:53:44.019551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d1a209bf-26f2-4445-b3c0-7a6ec428977a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:44.020518 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d1a209bf-26f2-4445-b3c0-7a6ec428977a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:44.029254 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1a209bf-26f2-4445-b3c0-7a6ec428977a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:44.029953 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1a209bf-26f2-4445-b3c0-7a6ec428977a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:44.030610 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1a209bf-26f2-4445-b3c0-7a6ec428977a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:44.031504 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1a209bf-26f2-4445-b3c0-7a6ec428977a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:44.032183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1a209bf-26f2-4445-b3c0-7a6ec428977a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:44.032778 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1a209bf-26f2-4445-b3c0-7a6ec428977a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:44.152870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=4 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:44.390574 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d1a209bf-26f2-4445-b3c0-7a6ec428977a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:44.412608 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d1a209bf-26f2-4445-b3c0-7a6ec428977a tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1714 microversion: 2.1 time: 0.397654 Aug 29 23:53:44.413233 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 160/331] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:44 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1714 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:44.425896 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-3bdf4e9f-471a-4516-9ed2-d3d6e8130b3f req-dab13ffb-0c55-4e92-b958-1bcb6b595c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c3a360a-1fe2-45f0-ad59-f9e69381ac28", "name": "network-vif-plugged", "status": "completed", "tag": "4496c220-d785-47cc-8a05-42c8832bf15c"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:44.465552 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-3bdf4e9f-471a-4516-9ed2-d3d6e8130b3f req-dab13ffb-0c55-4e92-b958-1bcb6b595c4a service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:44.467401 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-3bdf4e9f-471a-4516-9ed2-d3d6e8130b3f req-dab13ffb-0c55-4e92-b958-1bcb6b595c4a service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:44.468338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-3bdf4e9f-471a-4516-9ed2-d3d6e8130b3f req-dab13ffb-0c55-4e92-b958-1bcb6b595c4a service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:44.493333 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-3bdf4e9f-471a-4516-9ed2-d3d6e8130b3f req-dab13ffb-0c55-4e92-b958-1bcb6b595c4a service nova] Creating event network-vif-plugged:4496c220-d785-47cc-8a05-42c8832bf15c for instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 on hv-cinder-85427 Aug 29 23:53:44.499916 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-3bdf4e9f-471a-4516-9ed2-d3d6e8130b3f req-dab13ffb-0c55-4e92-b958-1bcb6b595c4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085331 Aug 29 23:53:44.501631 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 161/332] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:44.508705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b9828440-628d-4940-a765-42c2326663eb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:44.510656 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b9828440-628d-4940-a765-42c2326663eb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:44.614222 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b9828440-628d-4940-a765-42c2326663eb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:44.642058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b9828440-628d-4940-a765-42c2326663eb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1242 microversion: 2.1 time: 0.138340 Aug 29 23:53:44.643869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 162/333] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:44 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:44.649865 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:44.651195 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:44.663687 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:44.670746 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:44.671842 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:44.676573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:44.677505 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:44.680042 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:44.757744 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:53:44.758651 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:53:44.758651 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:53:44.759054 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:53:44.759460 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:53:44.774445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:44.777394 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:44.777394 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:44.777786 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:44.778435 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:44.779081 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:44.809790 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Getting quotas for project 87299c60c42b43e7bf7e8f92f30ae87d. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:53:44.816053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Getting quotas for user 74d57012e9a04960b6c5dde2243dafbc and project 87299c60c42b43e7bf7e8f92f30ae87d. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:53:44.859143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:53:44.866464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:53:45.037123 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:45.038763 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-363e2aff-5581-4a6b-98cb-519d85dad540 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426339 Aug 29 23:53:45.052474 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:45.054063 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:45.057966 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-279837e2-a8db-4bba-9983-29c7bd517373 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.410218 Aug 29 23:53:45.057966 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 163/334] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:44 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:45.076887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-42914ea0-5975-4e1f-8022-5413173c2579 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:45.077923 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-42914ea0-5975-4e1f-8022-5413173c2579 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:45.083483 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 172/335] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:53:45.099440 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-73e6862f-7679-44e5-ae4f-ddb60274b0d8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:45.101035 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-73e6862f-7679-44e5-ae4f-ddb60274b0d8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:45.112151 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42914ea0-5975-4e1f-8022-5413173c2579 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:45.116680 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42914ea0-5975-4e1f-8022-5413173c2579 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:45.124148 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42914ea0-5975-4e1f-8022-5413173c2579 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:45.124919 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42914ea0-5975-4e1f-8022-5413173c2579 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:45.128057 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42914ea0-5975-4e1f-8022-5413173c2579 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:45.130140 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42914ea0-5975-4e1f-8022-5413173c2579 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:45.405440 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-73e6862f-7679-44e5-ae4f-ddb60274b0d8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:45.414369 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-73e6862f-7679-44e5-ae4f-ddb60274b0d8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1214 microversion: 2.1 time: 0.328984 Aug 29 23:53:45.417145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 173/336] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:45 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:45.668719 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c4235caf-afb4-45a3-8d90-737abfdfa785 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:45.669339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c4235caf-afb4-45a3-8d90-737abfdfa785 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:45.692230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-42914ea0-5975-4e1f-8022-5413173c2579 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:45.715546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-42914ea0-5975-4e1f-8022-5413173c2579 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1369 microversion: 2.1 time: 0.641826 Aug 29 23:53:45.716367 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 164/337] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:45 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1369 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:45.804705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c4235caf-afb4-45a3-8d90-737abfdfa785 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:45.836768 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c4235caf-afb4-45a3-8d90-737abfdfa785 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1242 microversion: 2.1 time: 0.172182 Aug 29 23:53:45.837824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 174/338] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:45 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1242 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:46.081644 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:46.082268 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:46.090241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:46.090241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:46.090684 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:46.111228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:46.111228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:46.111228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:46.111228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:46.269440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:46.280114 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:46.281571 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:46.282772 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-127bfde1-d2dd-4c7f-9028-463cee715036 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1743 microversion: 2.20 time: 0.206255 Aug 29 23:53:46.283390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 165/339] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:46 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1743 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:46.459267 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9aa557c8-018a-4fc5-9629-8f973001354d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:46.463391 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9aa557c8-018a-4fc5-9629-8f973001354d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:46.550079 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9aa557c8-018a-4fc5-9629-8f973001354d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:46.562830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9aa557c8-018a-4fc5-9629-8f973001354d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1214 microversion: 2.1 time: 0.107113 Aug 29 23:53:46.563631 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 175/340] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:46 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:46.737838 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-271fd365-4895-4f58-9dae-20f23da132b9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:46.738686 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-271fd365-4895-4f58-9dae-20f23da132b9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:46.755431 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-271fd365-4895-4f58-9dae-20f23da132b9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:46.760446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-271fd365-4895-4f58-9dae-20f23da132b9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:46.761005 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-271fd365-4895-4f58-9dae-20f23da132b9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:46.763369 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-271fd365-4895-4f58-9dae-20f23da132b9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:46.765010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-271fd365-4895-4f58-9dae-20f23da132b9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:46.765883 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-271fd365-4895-4f58-9dae-20f23da132b9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:46.863760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c9e05c5b-ee1a-44be-8212-2a2f2c902ba3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:46.864923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c9e05c5b-ee1a-44be-8212-2a2f2c902ba3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:46.885253 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9e05c5b-ee1a-44be-8212-2a2f2c902ba3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:46.886355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9e05c5b-ee1a-44be-8212-2a2f2c902ba3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:46.887126 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9e05c5b-ee1a-44be-8212-2a2f2c902ba3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:46.887999 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9e05c5b-ee1a-44be-8212-2a2f2c902ba3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:46.888610 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9e05c5b-ee1a-44be-8212-2a2f2c902ba3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:46.889141 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9e05c5b-ee1a-44be-8212-2a2f2c902ba3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:47.039573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c9e05c5b-ee1a-44be-8212-2a2f2c902ba3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:47.051772 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c9e05c5b-ee1a-44be-8212-2a2f2c902ba3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1238 microversion: 2.1 time: 0.192492 Aug 29 23:53:47.055097 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 176/341] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:46 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1238 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:47.093558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-271fd365-4895-4f58-9dae-20f23da132b9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:47.123972 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-271fd365-4895-4f58-9dae-20f23da132b9 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1369 microversion: 2.1 time: 0.390408 Aug 29 23:53:47.127416 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 166/342] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:46 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1369 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:47.316925 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:47.317867 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:47.331221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:47.338724 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:47.340499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:47.341561 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:47.345226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:47.347395 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:47.591239 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-738beee2-c1a6-445d-954e-3fc44a14d36e tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:47.599213 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-738beee2-c1a6-445d-954e-3fc44a14d36e tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:47.612328 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-738beee2-c1a6-445d-954e-3fc44a14d36e tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:47.613218 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-738beee2-c1a6-445d-954e-3fc44a14d36e tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:47.613997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-738beee2-c1a6-445d-954e-3fc44a14d36e tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:47.615499 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-738beee2-c1a6-445d-954e-3fc44a14d36e tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:47.627625 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-738beee2-c1a6-445d-954e-3fc44a14d36e tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:47.638025 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-738beee2-c1a6-445d-954e-3fc44a14d36e tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:47.711300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:47.722262 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:47.724483 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:47.725917 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fba7bdd7-5660-425b-9329-442f7f342f6b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1743 microversion: 2.20 time: 0.420447 Aug 29 23:53:47.726981 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 177/343] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:47 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1743 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:53:47.790123 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-738beee2-c1a6-445d-954e-3fc44a14d36e tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:47.820446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-738beee2-c1a6-445d-954e-3fc44a14d36e tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1210 microversion: 2.1 time: 0.236023 Aug 29 23:53:47.829744 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 167/344] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:47 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1210 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:48.097545 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b42ad45d-cb8c-4a3f-864d-179733a6653f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:48.110568 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b42ad45d-cb8c-4a3f-864d-179733a6653f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:48.132377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b42ad45d-cb8c-4a3f-864d-179733a6653f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.133261 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b42ad45d-cb8c-4a3f-864d-179733a6653f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.136260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b42ad45d-cb8c-4a3f-864d-179733a6653f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.137754 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b42ad45d-cb8c-4a3f-864d-179733a6653f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.142171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b42ad45d-cb8c-4a3f-864d-179733a6653f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.144339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b42ad45d-cb8c-4a3f-864d-179733a6653f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.156305 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0d6c6c93-3bd0-4e4b-a3f3-b1e04ba2b06a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:48.161700 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0d6c6c93-3bd0-4e4b-a3f3-b1e04ba2b06a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:48.174916 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6c6c93-3bd0-4e4b-a3f3-b1e04ba2b06a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.176196 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6c6c93-3bd0-4e4b-a3f3-b1e04ba2b06a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.177171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6c6c93-3bd0-4e4b-a3f3-b1e04ba2b06a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.178664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6c6c93-3bd0-4e4b-a3f3-b1e04ba2b06a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.179853 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6c6c93-3bd0-4e4b-a3f3-b1e04ba2b06a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.181043 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6c6c93-3bd0-4e4b-a3f3-b1e04ba2b06a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.296098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b42ad45d-cb8c-4a3f-864d-179733a6653f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:48.320858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b42ad45d-cb8c-4a3f-864d-179733a6653f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1294 microversion: 2.1 time: 0.249188 Aug 29 23:53:48.331123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 178/345] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:48 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1294 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:48.526382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0d6c6c93-3bd0-4e4b-a3f3-b1e04ba2b06a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:48.545140 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0d6c6c93-3bd0-4e4b-a3f3-b1e04ba2b06a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1564 microversion: 2.1 time: 0.398052 Aug 29 23:53:48.547513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 168/346] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:48 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1564 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:48.579355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0ecd25f5-0327-4e2d-96ac-df03439a122a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:48.579849 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0ecd25f5-0327-4e2d-96ac-df03439a122a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:48.592731 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ecd25f5-0327-4e2d-96ac-df03439a122a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.593302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ecd25f5-0327-4e2d-96ac-df03439a122a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.594046 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ecd25f5-0327-4e2d-96ac-df03439a122a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.595466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ecd25f5-0327-4e2d-96ac-df03439a122a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.596138 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ecd25f5-0327-4e2d-96ac-df03439a122a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.597373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ecd25f5-0327-4e2d-96ac-df03439a122a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.706988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0ecd25f5-0327-4e2d-96ac-df03439a122a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131458 Aug 29 23:53:48.708293 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 179/347] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Aug 29 23:53:48 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:48.752980 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:48.753859 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:48.761320 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.762380 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.763150 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.764077 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.764683 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.765258 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.872493 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e8bf1207-080a-440b-a53b-4d441b528db3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:48.874813 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e8bf1207-080a-440b-a53b-4d441b528db3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:48.887058 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e8bf1207-080a-440b-a53b-4d441b528db3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.887903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e8bf1207-080a-440b-a53b-4d441b528db3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.889450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e8bf1207-080a-440b-a53b-4d441b528db3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:48.893826 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e8bf1207-080a-440b-a53b-4d441b528db3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:48.893826 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e8bf1207-080a-440b-a53b-4d441b528db3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:48.893826 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e8bf1207-080a-440b-a53b-4d441b528db3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:49.008165 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:49.023096 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:49.027376 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:49.032948 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e8bf1207-080a-440b-a53b-4d441b528db3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:49.042436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e8bf1207-080a-440b-a53b-4d441b528db3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1266 microversion: 2.1 time: 0.174454 Aug 29 23:53:49.046694 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d2ebcfdb-1081-46a3-99ce-a624ddddfe49 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.298040 Aug 29 23:53:49.047662 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 180/348] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:48 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:49.048452 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 169/349] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:48 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:49.361109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-659861a4-b2d8-46e9-8bb4-1776c3c4820a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:49.362195 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-659861a4-b2d8-46e9-8bb4-1776c3c4820a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:49.374622 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-659861a4-b2d8-46e9-8bb4-1776c3c4820a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:49.375475 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-659861a4-b2d8-46e9-8bb4-1776c3c4820a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:49.376508 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-659861a4-b2d8-46e9-8bb4-1776c3c4820a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:49.378239 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-659861a4-b2d8-46e9-8bb4-1776c3c4820a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:49.379115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-659861a4-b2d8-46e9-8bb4-1776c3c4820a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:49.380111 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-659861a4-b2d8-46e9-8bb4-1776c3c4820a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:49.521018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-659861a4-b2d8-46e9-8bb4-1776c3c4820a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:49.537460 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-659861a4-b2d8-46e9-8bb4-1776c3c4820a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1294 microversion: 2.1 time: 0.184888 Aug 29 23:53:49.550497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 181/350] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:49 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1294 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:50.064346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-53af8fa6-aef0-49f4-8bcf-a6372cdb2e46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:50.066168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-53af8fa6-aef0-49f4-8bcf-a6372cdb2e46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:50.072858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:50.073766 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:50.092344 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:50.093418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53af8fa6-aef0-49f4-8bcf-a6372cdb2e46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:50.100885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:50.101212 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53af8fa6-aef0-49f4-8bcf-a6372cdb2e46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:50.101298 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:50.101298 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:50.101808 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53af8fa6-aef0-49f4-8bcf-a6372cdb2e46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:50.103658 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53af8fa6-aef0-49f4-8bcf-a6372cdb2e46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:50.108661 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:50.109652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53af8fa6-aef0-49f4-8bcf-a6372cdb2e46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:50.110414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:50.118036 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53af8fa6-aef0-49f4-8bcf-a6372cdb2e46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:50.398579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-53af8fa6-aef0-49f4-8bcf-a6372cdb2e46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:50.398579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-53af8fa6-aef0-49f4-8bcf-a6372cdb2e46 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1266 microversion: 2.1 time: 0.335523 Aug 29 23:53:50.401574 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 170/351] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:50 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:50.408169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-abb7db0f-8bb5-45a9-8796-8e4e25ee75dd req-5a8334a3-e54b-4f07-b5b0-854e7a79817b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c3a360a-1fe2-45f0-ad59-f9e69381ac28", "tag": "4496c220-d785-47cc-8a05-42c8832bf15c"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:50.448830 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-abb7db0f-8bb5-45a9-8796-8e4e25ee75dd req-5a8334a3-e54b-4f07-b5b0-854e7a79817b service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:50.452984 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-abb7db0f-8bb5-45a9-8796-8e4e25ee75dd req-5a8334a3-e54b-4f07-b5b0-854e7a79817b service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:50.455176 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-abb7db0f-8bb5-45a9-8796-8e4e25ee75dd req-5a8334a3-e54b-4f07-b5b0-854e7a79817b service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:50.479152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-abb7db0f-8bb5-45a9-8796-8e4e25ee75dd req-5a8334a3-e54b-4f07-b5b0-854e7a79817b service nova] Creating event network-changed:4496c220-d785-47cc-8a05-42c8832bf15c for instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 on hv-cinder-85427 Aug 29 23:53:50.485837 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-abb7db0f-8bb5-45a9-8796-8e4e25ee75dd req-5a8334a3-e54b-4f07-b5b0-854e7a79817b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082517 Aug 29 23:53:50.490196 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 171/352] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:50.528570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:50.540076 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:50.541618 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:50.542880 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a0fac822-47db-4282-b9ac-52db2eee0a73 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.474479 Aug 29 23:53:50.543663 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 182/353] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:50 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:50.570661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6cf0b704-91b2-40d1-94f6-01fd3199181f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:50.573432 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6cf0b704-91b2-40d1-94f6-01fd3199181f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:50.581786 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6cf0b704-91b2-40d1-94f6-01fd3199181f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:50.582524 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6cf0b704-91b2-40d1-94f6-01fd3199181f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:50.583281 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6cf0b704-91b2-40d1-94f6-01fd3199181f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:50.585560 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6cf0b704-91b2-40d1-94f6-01fd3199181f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:50.586085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6cf0b704-91b2-40d1-94f6-01fd3199181f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:50.586657 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6cf0b704-91b2-40d1-94f6-01fd3199181f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:50.676731 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6cf0b704-91b2-40d1-94f6-01fd3199181f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:50.684783 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6cf0b704-91b2-40d1-94f6-01fd3199181f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1294 microversion: 2.1 time: 0.120736 Aug 29 23:53:50.685375 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 172/354] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:50 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:50.727116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-4ea7e271-201a-4ffc-9995-dc87bc82a2e8 req-db976ed3-8c3e-4b62-8474-a8a9162481a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781bf4fc-f6e6-4efc-b757-5888339b6b3c", "name": "network-vif-plugged", "status": "completed", "tag": "70011c53-2246-46a9-9308-734ee213614a"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:50.737900 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-4ea7e271-201a-4ffc-9995-dc87bc82a2e8 req-db976ed3-8c3e-4b62-8474-a8a9162481a2 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:50.738368 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-4ea7e271-201a-4ffc-9995-dc87bc82a2e8 req-db976ed3-8c3e-4b62-8474-a8a9162481a2 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:50.738820 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-4ea7e271-201a-4ffc-9995-dc87bc82a2e8 req-db976ed3-8c3e-4b62-8474-a8a9162481a2 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:50.750331 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-4ea7e271-201a-4ffc-9995-dc87bc82a2e8 req-db976ed3-8c3e-4b62-8474-a8a9162481a2 service nova] Creating event network-vif-plugged:70011c53-2246-46a9-9308-734ee213614a for instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c on hv-cinder-85427 Aug 29 23:53:50.755793 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-4ea7e271-201a-4ffc-9995-dc87bc82a2e8 req-db976ed3-8c3e-4b62-8474-a8a9162481a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032387 Aug 29 23:53:50.756378 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 183/355] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:53:51.438167 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0886f2c0-d2f4-431a-8074-a5ba025f8160 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:51.439824 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0886f2c0-d2f4-431a-8074-a5ba025f8160 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:51.449913 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0886f2c0-d2f4-431a-8074-a5ba025f8160 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:51.455315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0886f2c0-d2f4-431a-8074-a5ba025f8160 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:51.455315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0886f2c0-d2f4-431a-8074-a5ba025f8160 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:51.455315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0886f2c0-d2f4-431a-8074-a5ba025f8160 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:51.456111 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0886f2c0-d2f4-431a-8074-a5ba025f8160 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:51.457977 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0886f2c0-d2f4-431a-8074-a5ba025f8160 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:51.569819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:51.571216 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:51.578756 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:51.579621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:51.580294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:51.581207 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:51.581912 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:51.582576 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:51.602247 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0886f2c0-d2f4-431a-8074-a5ba025f8160 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:51.623880 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0886f2c0-d2f4-431a-8074-a5ba025f8160 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1266 microversion: 2.1 time: 0.188807 Aug 29 23:53:51.642608 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 173/356] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:51 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:51.733445 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d2217afa-7d60-42da-bf4b-9a57b2333b11 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:51.734858 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d2217afa-7d60-42da-bf4b-9a57b2333b11 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:51.762829 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2217afa-7d60-42da-bf4b-9a57b2333b11 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:51.763876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2217afa-7d60-42da-bf4b-9a57b2333b11 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:51.765958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2217afa-7d60-42da-bf4b-9a57b2333b11 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:51.770489 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2217afa-7d60-42da-bf4b-9a57b2333b11 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:51.771763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2217afa-7d60-42da-bf4b-9a57b2333b11 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:51.774012 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d2217afa-7d60-42da-bf4b-9a57b2333b11 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:51.975825 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d2217afa-7d60-42da-bf4b-9a57b2333b11 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:51.983365 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d2217afa-7d60-42da-bf4b-9a57b2333b11 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1302 microversion: 2.1 time: 0.279331 Aug 29 23:53:51.988087 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 174/357] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:51 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1302 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:52.098028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:52.112891 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:52.129348 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:52.131364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c4b90da7-8f4c-46b4-a132-9438b63387ad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.566657 Aug 29 23:53:52.133668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 184/358] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:51 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:52.652892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1e1d8c93-ddf2-44ec-9687-3271c039d961 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:52.653749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1e1d8c93-ddf2-44ec-9687-3271c039d961 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:52.667840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c93-ddf2-44ec-9687-3271c039d961 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:52.669870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c93-ddf2-44ec-9687-3271c039d961 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:52.670570 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c93-ddf2-44ec-9687-3271c039d961 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:52.673797 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c93-ddf2-44ec-9687-3271c039d961 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:52.674613 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c93-ddf2-44ec-9687-3271c039d961 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:52.676944 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1e1d8c93-ddf2-44ec-9687-3271c039d961 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:52.875056 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1e1d8c93-ddf2-44ec-9687-3271c039d961 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:52.888296 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1e1d8c93-ddf2-44ec-9687-3271c039d961 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1284 microversion: 2.1 time: 0.239235 Aug 29 23:53:52.903349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 175/359] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:52 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:53.006841 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-eb15614e-f375-4f08-9f60-cc3c861c43fe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:53.007473 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-eb15614e-f375-4f08-9f60-cc3c861c43fe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:53.020788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb15614e-f375-4f08-9f60-cc3c861c43fe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:53.026254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb15614e-f375-4f08-9f60-cc3c861c43fe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:53.026254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb15614e-f375-4f08-9f60-cc3c861c43fe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:53.026254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb15614e-f375-4f08-9f60-cc3c861c43fe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:53.026254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb15614e-f375-4f08-9f60-cc3c861c43fe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:53.027128 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb15614e-f375-4f08-9f60-cc3c861c43fe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:53.173382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:53.174343 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:53.186359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:53.187153 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:53.187594 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:53.188317 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:53.190955 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:53.191680 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:53.257443 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-eb15614e-f375-4f08-9f60-cc3c861c43fe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:53.267413 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-eb15614e-f375-4f08-9f60-cc3c861c43fe tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1300 microversion: 2.1 time: 0.264941 Aug 29 23:53:53.268003 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 185/360] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:53 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1300 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:53.513945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:53.918378 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ff8ff01b-3b5f-46ed-a031-8f955f4f8e36 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:53.919154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ff8ff01b-3b5f-46ed-a031-8f955f4f8e36 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:53.945591 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff8ff01b-3b5f-46ed-a031-8f955f4f8e36 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:53.946094 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff8ff01b-3b5f-46ed-a031-8f955f4f8e36 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:53.954712 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff8ff01b-3b5f-46ed-a031-8f955f4f8e36 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:53.955825 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff8ff01b-3b5f-46ed-a031-8f955f4f8e36 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:53.956350 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff8ff01b-3b5f-46ed-a031-8f955f4f8e36 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:53.956749 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff8ff01b-3b5f-46ed-a031-8f955f4f8e36 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:53.994119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:54.020629 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:54.023256 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:54.035593 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-597b71bc-eef0-432b-8365-909c251e2b52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.871200 Aug 29 23:53:54.050740 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 176/361] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:53 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:54.208424 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ff8ff01b-3b5f-46ed-a031-8f955f4f8e36 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:54.235422 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ff8ff01b-3b5f-46ed-a031-8f955f4f8e36 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1272 microversion: 2.1 time: 0.329948 Aug 29 23:53:54.249502 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 186/362] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:53 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:54.289637 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c22651ea-e016-49a2-ab27-6281589b6bf4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:54.291133 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c22651ea-e016-49a2-ab27-6281589b6bf4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:54.317564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c22651ea-e016-49a2-ab27-6281589b6bf4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:54.318622 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c22651ea-e016-49a2-ab27-6281589b6bf4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:54.324526 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c22651ea-e016-49a2-ab27-6281589b6bf4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:54.324526 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c22651ea-e016-49a2-ab27-6281589b6bf4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:54.324526 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c22651ea-e016-49a2-ab27-6281589b6bf4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:54.324526 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c22651ea-e016-49a2-ab27-6281589b6bf4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:54.628563 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=8 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:54.701918 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c22651ea-e016-49a2-ab27-6281589b6bf4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:54.717658 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c22651ea-e016-49a2-ab27-6281589b6bf4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1367 microversion: 2.1 time: 0.431639 Aug 29 23:53:54.741678 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 177/363] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:54 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:53:55.064556 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:55.065172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:55.067218 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:55.079549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:55.079549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:55.079549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:55.079549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:55.079885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:55.079885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:55.304460 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5cd5d57f-1f37-4666-9af6-e9c2a911baf4 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:55.306296 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5cd5d57f-1f37-4666-9af6-e9c2a911baf4 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:55.358015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cd5d57f-1f37-4666-9af6-e9c2a911baf4 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:55.358843 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cd5d57f-1f37-4666-9af6-e9c2a911baf4 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:55.359530 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cd5d57f-1f37-4666-9af6-e9c2a911baf4 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:55.362702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cd5d57f-1f37-4666-9af6-e9c2a911baf4 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:55.378174 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cd5d57f-1f37-4666-9af6-e9c2a911baf4 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:55.382996 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5cd5d57f-1f37-4666-9af6-e9c2a911baf4 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:55.672331 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:55.695188 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:55.697906 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:55.699672 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ce4520d0-a1f3-4606-a95c-2933a3e1885d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.639182 Aug 29 23:53:55.711122 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 187/364] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:55 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:55.727506 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-77fa771a-72ea-4b2f-b767-1a31a355c2fa req-83f10d17-5343-4a0c-8f4a-f649a234aaac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57d3d9f-7fe5-45b7-8e55-2652336c453b", "tag": "acc77992-4cc6-4366-b576-3d7fb81a0859"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:55.777961 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-77fa771a-72ea-4b2f-b767-1a31a355c2fa req-83f10d17-5343-4a0c-8f4a-f649a234aaac service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:55.779253 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-77fa771a-72ea-4b2f-b767-1a31a355c2fa req-83f10d17-5343-4a0c-8f4a-f649a234aaac service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:55.785585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-77fa771a-72ea-4b2f-b767-1a31a355c2fa req-83f10d17-5343-4a0c-8f4a-f649a234aaac service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:55.832094 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-77fa771a-72ea-4b2f-b767-1a31a355c2fa req-83f10d17-5343-4a0c-8f4a-f649a234aaac service nova] Creating event network-changed:acc77992-4cc6-4366-b576-3d7fb81a0859 for instance b57d3d9f-7fe5-45b7-8e55-2652336c453b on hv-cinder-85427 Aug 29 23:53:55.863070 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-77fa771a-72ea-4b2f-b767-1a31a355c2fa req-83f10d17-5343-4a0c-8f4a-f649a234aaac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138659 Aug 29 23:53:55.864536 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 188/365] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:53:55.873557 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-538783cd-563c-4f95-8d8e-4e201fb9eadc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:55.875157 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-538783cd-563c-4f95-8d8e-4e201fb9eadc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:55.891327 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538783cd-563c-4f95-8d8e-4e201fb9eadc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:55.892170 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538783cd-563c-4f95-8d8e-4e201fb9eadc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:55.892934 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538783cd-563c-4f95-8d8e-4e201fb9eadc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:55.896687 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538783cd-563c-4f95-8d8e-4e201fb9eadc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:55.897577 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538783cd-563c-4f95-8d8e-4e201fb9eadc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:55.901243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-538783cd-563c-4f95-8d8e-4e201fb9eadc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:56.071742 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5cd5d57f-1f37-4666-9af6-e9c2a911baf4 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:56.083528 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5cd5d57f-1f37-4666-9af6-e9c2a911baf4 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.794874 Aug 29 23:53:56.086013 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 178/366] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:55 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:56.408619 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-538783cd-563c-4f95-8d8e-4e201fb9eadc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:56.430206 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-538783cd-563c-4f95-8d8e-4e201fb9eadc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1367 microversion: 2.1 time: 0.563852 Aug 29 23:53:56.432338 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 189/367] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:55 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:56.738344 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:56.739364 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:56.754386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:56.756062 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:56.773113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:56.775426 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:56.776188 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:56.777998 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:57.064958 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-3e93fa26-428f-4f71-97c0-d545c9d305fc req-a3b7368f-265a-4b2d-9886-32760c9609cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bcefc4-8780-4660-ab70-6348d13dc688", "tag": "4c751dea-da0b-48df-84d7-047dd5c836e0"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:53:57.081461 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=12 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:57.084035 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-3e93fa26-428f-4f71-97c0-d545c9d305fc req-a3b7368f-265a-4b2d-9886-32760c9609cd service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:57.095216 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-3e93fa26-428f-4f71-97c0-d545c9d305fc req-a3b7368f-265a-4b2d-9886-32760c9609cd service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:57.095771 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-3e93fa26-428f-4f71-97c0-d545c9d305fc req-a3b7368f-265a-4b2d-9886-32760c9609cd service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:57.142403 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-3e93fa26-428f-4f71-97c0-d545c9d305fc req-a3b7368f-265a-4b2d-9886-32760c9609cd service nova] Creating event network-changed:4c751dea-da0b-48df-84d7-047dd5c836e0 for instance 99bcefc4-8780-4660-ab70-6348d13dc688 on hv-cinder-85427 Aug 29 23:53:57.160811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-3e93fa26-428f-4f71-97c0-d545c9d305fc req-a3b7368f-265a-4b2d-9886-32760c9609cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105034 Aug 29 23:53:57.164675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 190/368] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 23:53:57.171722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-145c9b8b-8eed-4d39-94ff-12fbfe240c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:57.172753 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-145c9b8b-8eed-4d39-94ff-12fbfe240c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:57.218543 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-145c9b8b-8eed-4d39-94ff-12fbfe240c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:57.220148 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-145c9b8b-8eed-4d39-94ff-12fbfe240c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:57.220148 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-145c9b8b-8eed-4d39-94ff-12fbfe240c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:57.220459 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-145c9b8b-8eed-4d39-94ff-12fbfe240c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:57.220950 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-145c9b8b-8eed-4d39-94ff-12fbfe240c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:57.221565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-145c9b8b-8eed-4d39-94ff-12fbfe240c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:57.582347 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:57.596296 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:57.657731 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:57.663311 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-66e8be38-24ed-4b66-bb7f-c5b0cf0baf05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.910385 Aug 29 23:53:57.664660 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 179/369] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:56 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:57.673076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2ea6fee2-6bd0-44ac-881e-bfbb7609b205 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:57.674120 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2ea6fee2-6bd0-44ac-881e-bfbb7609b205 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:57.697444 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2ea6fee2-6bd0-44ac-881e-bfbb7609b205 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:57.698214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2ea6fee2-6bd0-44ac-881e-bfbb7609b205 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:57.702586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2ea6fee2-6bd0-44ac-881e-bfbb7609b205 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:57.702586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2ea6fee2-6bd0-44ac-881e-bfbb7609b205 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:57.702586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2ea6fee2-6bd0-44ac-881e-bfbb7609b205 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:57.702586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2ea6fee2-6bd0-44ac-881e-bfbb7609b205 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:58.130545 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-145c9b8b-8eed-4d39-94ff-12fbfe240c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:58.147676 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-145c9b8b-8eed-4d39-94ff-12fbfe240c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.981544 Aug 29 23:53:58.148271 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 191/370] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:57 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:58.261231 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2ea6fee2-6bd0-44ac-881e-bfbb7609b205 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:58.274650 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2ea6fee2-6bd0-44ac-881e-bfbb7609b205 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1367 microversion: 2.1 time: 0.607772 Aug 29 23:53:58.276340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 180/371] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:57 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1367 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:53:58.705818 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:58.706371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:58.714067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:58.714873 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:58.715501 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:58.716371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:58.716997 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:58.717416 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:58.751483 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:58.982204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:58.991445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:58.992889 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:53:58.995446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-28e78ea8-212c-4dc9-b7fb-3fa3d9004f5e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.295840 Aug 29 23:53:58.996010 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 192/372] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:53:58 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:53:59.217359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-bbe77a46-9a14-4682-b4d9-5e81cd9a4bee tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:59.222238 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-bbe77a46-9a14-4682-b4d9-5e81cd9a4bee tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:59.267908 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bbe77a46-9a14-4682-b4d9-5e81cd9a4bee tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:59.269158 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bbe77a46-9a14-4682-b4d9-5e81cd9a4bee tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:59.269158 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bbe77a46-9a14-4682-b4d9-5e81cd9a4bee tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:59.270802 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bbe77a46-9a14-4682-b4d9-5e81cd9a4bee tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:59.282290 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bbe77a46-9a14-4682-b4d9-5e81cd9a4bee tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:59.283268 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bbe77a46-9a14-4682-b4d9-5e81cd9a4bee tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:59.301083 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6cc82f7b-de22-4911-8cc2-89f7be79c32a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:53:59.303396 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6cc82f7b-de22-4911-8cc2-89f7be79c32a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:53:59.332654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cc82f7b-de22-4911-8cc2-89f7be79c32a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:59.342777 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cc82f7b-de22-4911-8cc2-89f7be79c32a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:59.351099 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cc82f7b-de22-4911-8cc2-89f7be79c32a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:53:59.352219 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cc82f7b-de22-4911-8cc2-89f7be79c32a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:53:59.352871 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cc82f7b-de22-4911-8cc2-89f7be79c32a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:53:59.359695 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cc82f7b-de22-4911-8cc2-89f7be79c32a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:00.018718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6cc82f7b-de22-4911-8cc2-89f7be79c32a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:00.033102 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bbe77a46-9a14-4682-b4d9-5e81cd9a4bee tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:00.037070 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6cc82f7b-de22-4911-8cc2-89f7be79c32a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1367 microversion: 2.1 time: 0.743345 Aug 29 23:54:00.038142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 193/373] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:59 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1367 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:00.057498 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-bbe77a46-9a14-4682-b4d9-5e81cd9a4bee tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.883799 Aug 29 23:54:00.062030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 181/374] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:53:59 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:00.085874 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:00.088369 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:00.096485 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:00.097277 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:00.097880 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:00.098658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:00.099114 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:00.099541 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:00.304349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:00.319067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:00.322130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:00.322130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e4952498-ff94-4435-9400-a1088cbeb9f7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.265425 Aug 29 23:54:00.323075 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 194/375] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:00 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:00.917525 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2bb637ea-4d4f-45b6-b5e7-2282733855a1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Action: 'create', calling method: .version_select at 0x7fabbe189310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1653362230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVot1nT6kZmVtwg4UkJ56Fre3iR+NlvDbtlX2tSeGdKPmTqmJgZL+IdT53AAhmjFfyPhlp1mXgE38sf0GJEyQu/sqtGLfuVXSu5uKed9UdxO1V1IWmql8jnVZSdRiIFkQ=="}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:00.967053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-2bb637ea-4d4f-45b6-b5e7-2282733855a1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Getting quotas for project 2f665e85ae5b4008b60765fd3076a331. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:54:00.977149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-2bb637ea-4d4f-45b6-b5e7-2282733855a1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Getting quotas for user 27f78b50d76341e08e184582e8400a04 and project 2f665e85ae5b4008b60765fd3076a331. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:54:01.008089 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:01.090098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fd7d3624-27e4-48a7-bced-166e7e6741ee tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:01.091149 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fd7d3624-27e4-48a7-bced-166e7e6741ee tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:01.098046 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:01.108626 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2bb637ea-4d4f-45b6-b5e7-2282733855a1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.199984 Aug 29 23:54:01.110544 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 182/376] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Aug 29 23:54:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:01.131652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-22052e88-3317-4977-8d84-d5cce74820f8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:01.133455 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd7d3624-27e4-48a7-bced-166e7e6741ee tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:01.134941 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd7d3624-27e4-48a7-bced-166e7e6741ee tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:01.151282 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-22052e88-3317-4977-8d84-d5cce74820f8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:01.156721 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd7d3624-27e4-48a7-bced-166e7e6741ee tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:01.157496 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd7d3624-27e4-48a7-bced-166e7e6741ee tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:01.157977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd7d3624-27e4-48a7-bced-166e7e6741ee tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:01.158408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd7d3624-27e4-48a7-bced-166e7e6741ee tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:01.162341 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-22052e88-3317-4977-8d84-d5cce74820f8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:01.162892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-22052e88-3317-4977-8d84-d5cce74820f8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:01.163494 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-22052e88-3317-4977-8d84-d5cce74820f8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:01.164657 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-22052e88-3317-4977-8d84-d5cce74820f8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:01.166033 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-22052e88-3317-4977-8d84-d5cce74820f8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:01.166714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-22052e88-3317-4977-8d84-d5cce74820f8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:01.188110 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:01.410098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fd7d3624-27e4-48a7-bced-166e7e6741ee tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:01.421426 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fd7d3624-27e4-48a7-bced-166e7e6741ee tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1367 microversion: 2.1 time: 0.336689 Aug 29 23:54:01.438469 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 195/377] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:01 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:01.438469 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-850334550", "imageRef": "f6115823-956a-4710-9770-b0a365d50c66", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1653362230", "networks": [{"uuid": "b97d4e68-0c55-4a53-bf7a-6ed3a3de0378"}]}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:01.443278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-22052e88-3317-4977-8d84-d5cce74820f8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:01.453408 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-22052e88-3317-4977-8d84-d5cce74820f8 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.341022 Aug 29 23:54:01.467660 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 183/378] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:01 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:01.478911 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:01.480115 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:01.491152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:01.492448 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:01.494005 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:01.495345 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:01.496640 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:01.497262 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:01.521213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] validate_networks() for [('b97d4e68-0c55-4a53-bf7a-6ed3a3de0378', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:54:01.880446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:01.905517 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:01.916337 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:01.916337 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-274697a0-f0aa-4f18-96b2-8ecce0403a43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.450093 Aug 29 23:54:01.941243 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 184/379] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:01 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:02.262760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:54:02.263094 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:54:02.264305 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:54:02.264744 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:54:02.265335 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:54:02.293145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:02.294188 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:02.295018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:02.296414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:02.297223 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:02.297993 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:02.331331 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Getting quotas for project 2f665e85ae5b4008b60765fd3076a331. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:54:02.337527 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Getting quotas for user 27f78b50d76341e08e184582e8400a04 and project 2f665e85ae5b4008b60765fd3076a331. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:54:02.360819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:54:02.363649 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6115823-956a-4710-9770-b0a365d50c66',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:54:02.459972 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-355ea164-03b4-4f00-9470-e369391bc644 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:02.461149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-355ea164-03b4-4f00-9470-e369391bc644 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:02.469245 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-355ea164-03b4-4f00-9470-e369391bc644 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:02.470269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-355ea164-03b4-4f00-9470-e369391bc644 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:02.471405 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-355ea164-03b4-4f00-9470-e369391bc644 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:02.472152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-355ea164-03b4-4f00-9470-e369391bc644 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:02.472783 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-355ea164-03b4-4f00-9470-e369391bc644 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:02.473367 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-355ea164-03b4-4f00-9470-e369391bc644 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:02.582760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-78dc7c7b-875c-4e09-9682-86724f58eec2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.158660 Aug 29 23:54:02.584654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 196/380] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:54:02.590389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a6a57df6-b936-49ab-8f49-b2cc76309e17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:02.591033 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a6a57df6-b936-49ab-8f49-b2cc76309e17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:02.604105 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a6a57df6-b936-49ab-8f49-b2cc76309e17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:02.607198 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a6a57df6-b936-49ab-8f49-b2cc76309e17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:02.607198 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a6a57df6-b936-49ab-8f49-b2cc76309e17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:02.607198 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a6a57df6-b936-49ab-8f49-b2cc76309e17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:02.607198 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a6a57df6-b936-49ab-8f49-b2cc76309e17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:02.607799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a6a57df6-b936-49ab-8f49-b2cc76309e17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:02.736160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-355ea164-03b4-4f00-9470-e369391bc644 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:02.748661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-355ea164-03b4-4f00-9470-e369391bc644 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1367 microversion: 2.1 time: 0.292493 Aug 29 23:54:02.749403 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 185/381] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:02 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:02.777055 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c00ff206-7dce-452b-a3b7-4a175ce038b3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:02.781092 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c00ff206-7dce-452b-a3b7-4a175ce038b3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:02.898722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c00ff206-7dce-452b-a3b7-4a175ce038b3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:02.912328 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c00ff206-7dce-452b-a3b7-4a175ce038b3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1258 microversion: 2.1 time: 0.149065 Aug 29 23:54:02.912983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 186/382] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:02 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:02.954276 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a6a57df6-b936-49ab-8f49-b2cc76309e17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:02.955640 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:02.956649 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:02.965661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:02.967288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:02.967984 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:02.968955 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:02.969936 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:02.970668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:02.971239 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a6a57df6-b936-49ab-8f49-b2cc76309e17 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.385071 Aug 29 23:54:02.973664 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 197/383] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:02 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:03.165977 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:03.176137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:03.178536 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:03.181173 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9fb49376-d7b7-4022-9508-02b62272aeaa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.231068 Aug 29 23:54:03.182452 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 187/384] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:02 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:03.771008 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-bddab496-5412-4555-b43b-709ccd0a5b7e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:03.771912 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-bddab496-5412-4555-b43b-709ccd0a5b7e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:03.780237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bddab496-5412-4555-b43b-709ccd0a5b7e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:03.780745 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bddab496-5412-4555-b43b-709ccd0a5b7e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:03.781172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bddab496-5412-4555-b43b-709ccd0a5b7e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:03.781891 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bddab496-5412-4555-b43b-709ccd0a5b7e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:03.782397 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bddab496-5412-4555-b43b-709ccd0a5b7e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:03.782900 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bddab496-5412-4555-b43b-709ccd0a5b7e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:03.940808 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6a377b3f-6313-47a0-ac78-169092bd08e1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:03.940808 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6a377b3f-6313-47a0-ac78-169092bd08e1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:03.943811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bddab496-5412-4555-b43b-709ccd0a5b7e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:03.956259 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-bddab496-5412-4555-b43b-709ccd0a5b7e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1367 microversion: 2.1 time: 0.190698 Aug 29 23:54:03.970217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 198/385] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:03 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:03.999552 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3e6f5419-ba22-4fb1-ac77-34f0ef3e3526 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:04.000162 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3e6f5419-ba22-4fb1-ac77-34f0ef3e3526 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:04.006411 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e6f5419-ba22-4fb1-ac77-34f0ef3e3526 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:04.006918 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e6f5419-ba22-4fb1-ac77-34f0ef3e3526 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:04.007345 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e6f5419-ba22-4fb1-ac77-34f0ef3e3526 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:04.008041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e6f5419-ba22-4fb1-ac77-34f0ef3e3526 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:04.008485 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e6f5419-ba22-4fb1-ac77-34f0ef3e3526 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:04.009479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e6f5419-ba22-4fb1-ac77-34f0ef3e3526 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:04.025805 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6a377b3f-6313-47a0-ac78-169092bd08e1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:04.035039 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6a377b3f-6313-47a0-ac78-169092bd08e1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1258 microversion: 2.1 time: 0.104081 Aug 29 23:54:04.035864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 188/386] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:03 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1258 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:04.208545 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:04.209195 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:04.223559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:04.229384 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:04.229384 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:04.229384 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:04.229384 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:04.240690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:04.404157 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3e6f5419-ba22-4fb1-ac77-34f0ef3e3526 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:04.431257 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3e6f5419-ba22-4fb1-ac77-34f0ef3e3526 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.417041 Aug 29 23:54:04.431257 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 199/387] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:03 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:04.601563 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:04.613190 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:04.614802 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:04.616122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-50523338-dc33-42a6-8472-c9992442933c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.413488 Aug 29 23:54:04.616751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 189/388] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:04 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:04.977930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-67c23194-b9b6-4e36-9537-77083f27d710 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:04.979822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-67c23194-b9b6-4e36-9537-77083f27d710 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:04.987427 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67c23194-b9b6-4e36-9537-77083f27d710 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:04.988223 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67c23194-b9b6-4e36-9537-77083f27d710 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:04.988874 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67c23194-b9b6-4e36-9537-77083f27d710 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:04.989737 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67c23194-b9b6-4e36-9537-77083f27d710 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:04.990339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67c23194-b9b6-4e36-9537-77083f27d710 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:04.991120 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67c23194-b9b6-4e36-9537-77083f27d710 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:05.057973 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1287f99d-82dd-44b4-aeba-89c8b9870278 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:05.059122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1287f99d-82dd-44b4-aeba-89c8b9870278 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:05.074039 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1287f99d-82dd-44b4-aeba-89c8b9870278 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:05.077866 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1287f99d-82dd-44b4-aeba-89c8b9870278 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:05.084907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1287f99d-82dd-44b4-aeba-89c8b9870278 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:05.084907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1287f99d-82dd-44b4-aeba-89c8b9870278 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:05.084907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1287f99d-82dd-44b4-aeba-89c8b9870278 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:05.084907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1287f99d-82dd-44b4-aeba-89c8b9870278 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:05.234569 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1287f99d-82dd-44b4-aeba-89c8b9870278 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:05.251373 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1287f99d-82dd-44b4-aeba-89c8b9870278 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1262 microversion: 2.1 time: 0.199163 Aug 29 23:54:05.266374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 190/389] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:05 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1262 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:05.273698 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-67c23194-b9b6-4e36-9537-77083f27d710 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:05.285999 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-67c23194-b9b6-4e36-9537-77083f27d710 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1367 microversion: 2.1 time: 0.312577 Aug 29 23:54:05.299445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 200/390] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:04 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:05.453888 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ac22656b-7868-42b8-b888-46ba9af59bc1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:05.454588 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ac22656b-7868-42b8-b888-46ba9af59bc1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:05.462616 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ac22656b-7868-42b8-b888-46ba9af59bc1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:05.463124 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ac22656b-7868-42b8-b888-46ba9af59bc1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:05.463565 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ac22656b-7868-42b8-b888-46ba9af59bc1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:05.464301 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ac22656b-7868-42b8-b888-46ba9af59bc1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:05.464759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ac22656b-7868-42b8-b888-46ba9af59bc1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:05.465207 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ac22656b-7868-42b8-b888-46ba9af59bc1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:05.640867 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-ace95f5c-cdfa-42d8-81da-12fd71ef10dc req-1dc53dfc-23b6-48cd-a7a6-4c263abc8b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57d3d9f-7fe5-45b7-8e55-2652336c453b", "name": "network-vif-plugged", "status": "completed", "tag": "acc77992-4cc6-4366-b576-3d7fb81a0859"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:05.660277 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-ace95f5c-cdfa-42d8-81da-12fd71ef10dc req-1dc53dfc-23b6-48cd-a7a6-4c263abc8b0e service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:05.660939 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-ace95f5c-cdfa-42d8-81da-12fd71ef10dc req-1dc53dfc-23b6-48cd-a7a6-4c263abc8b0e service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:05.661464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-ace95f5c-cdfa-42d8-81da-12fd71ef10dc req-1dc53dfc-23b6-48cd-a7a6-4c263abc8b0e service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:05.690038 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-ace95f5c-cdfa-42d8-81da-12fd71ef10dc req-1dc53dfc-23b6-48cd-a7a6-4c263abc8b0e service nova] Creating event network-vif-plugged:acc77992-4cc6-4366-b576-3d7fb81a0859 for instance b57d3d9f-7fe5-45b7-8e55-2652336c453b on hv-cinder-85427 Aug 29 23:54:05.711021 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-ace95f5c-cdfa-42d8-81da-12fd71ef10dc req-1dc53dfc-23b6-48cd-a7a6-4c263abc8b0e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073962 Aug 29 23:54:05.720204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 201/391] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:05.729274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:05.742407 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:05.766682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:05.766682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:05.766682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:05.766682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:05.767047 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:05.767047 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:05.805007 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ac22656b-7868-42b8-b888-46ba9af59bc1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:05.823279 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ac22656b-7868-42b8-b888-46ba9af59bc1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.371198 Aug 29 23:54:05.832317 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 191/392] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:05 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:06.223229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:06.236858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:06.240862 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:06.240862 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-268b24d9-5e78-4090-a67d-8ea11936e62b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.515580 Aug 29 23:54:06.240862 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 202/393] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:05 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:06.277868 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b1aaf0da-8e6a-4a7c-bcad-db1f366e4f2c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:06.281971 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b1aaf0da-8e6a-4a7c-bcad-db1f366e4f2c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:06.304668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1aaf0da-8e6a-4a7c-bcad-db1f366e4f2c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:06.310316 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1aaf0da-8e6a-4a7c-bcad-db1f366e4f2c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:06.311139 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1aaf0da-8e6a-4a7c-bcad-db1f366e4f2c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:06.313159 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2a25686f-55b2-4807-b55a-a29e70725b6b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:06.316230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1aaf0da-8e6a-4a7c-bcad-db1f366e4f2c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:06.316962 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1aaf0da-8e6a-4a7c-bcad-db1f366e4f2c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:06.319202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1aaf0da-8e6a-4a7c-bcad-db1f366e4f2c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:06.331480 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2a25686f-55b2-4807-b55a-a29e70725b6b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:06.359554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a25686f-55b2-4807-b55a-a29e70725b6b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:06.371919 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a25686f-55b2-4807-b55a-a29e70725b6b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:06.373359 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a25686f-55b2-4807-b55a-a29e70725b6b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:06.386785 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a25686f-55b2-4807-b55a-a29e70725b6b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:06.386785 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a25686f-55b2-4807-b55a-a29e70725b6b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:06.397485 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a25686f-55b2-4807-b55a-a29e70725b6b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:06.503860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b1aaf0da-8e6a-4a7c-bcad-db1f366e4f2c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:06.513573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b1aaf0da-8e6a-4a7c-bcad-db1f366e4f2c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1310 microversion: 2.1 time: 0.241552 Aug 29 23:54:06.528664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 192/394] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:06 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1310 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:06.646513 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2a25686f-55b2-4807-b55a-a29e70725b6b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:06.659024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2a25686f-55b2-4807-b55a-a29e70725b6b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1367 microversion: 2.1 time: 0.353566 Aug 29 23:54:06.660046 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 203/395] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:06 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:06.847835 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-17dbdc63-676d-498e-9813-6f5cc93e6f4d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:06.848631 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-17dbdc63-676d-498e-9813-6f5cc93e6f4d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:06.856966 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-17dbdc63-676d-498e-9813-6f5cc93e6f4d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:06.857980 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-17dbdc63-676d-498e-9813-6f5cc93e6f4d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:06.858854 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-17dbdc63-676d-498e-9813-6f5cc93e6f4d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:06.860095 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-17dbdc63-676d-498e-9813-6f5cc93e6f4d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:06.860820 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-17dbdc63-676d-498e-9813-6f5cc93e6f4d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:06.861474 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-17dbdc63-676d-498e-9813-6f5cc93e6f4d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.157151 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-17dbdc63-676d-498e-9813-6f5cc93e6f4d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:07.169901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-17dbdc63-676d-498e-9813-6f5cc93e6f4d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.326172 Aug 29 23:54:07.171320 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 193/396] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:06 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:07.268787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:07.270309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:07.280197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.281144 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.281755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.283217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.283984 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.284472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.538588 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9f72854a-89a5-4959-adc2-0c48c65c9e0b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:07.541005 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9f72854a-89a5-4959-adc2-0c48c65c9e0b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:07.554385 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f72854a-89a5-4959-adc2-0c48c65c9e0b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.554949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f72854a-89a5-4959-adc2-0c48c65c9e0b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.556069 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f72854a-89a5-4959-adc2-0c48c65c9e0b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.567658 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f72854a-89a5-4959-adc2-0c48c65c9e0b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.573207 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f72854a-89a5-4959-adc2-0c48c65c9e0b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.584971 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f72854a-89a5-4959-adc2-0c48c65c9e0b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.592851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:07.603091 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:07.610463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:07.613163 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3bcd7db3-7429-4956-99ab-783901deb411 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.349491 Aug 29 23:54:07.630904 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 204/397] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:07 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:07.684947 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3187d849-f883-4d39-a1f9-ae250180f593 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:07.690153 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3187d849-f883-4d39-a1f9-ae250180f593 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:07.707238 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3187d849-f883-4d39-a1f9-ae250180f593 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.711205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3187d849-f883-4d39-a1f9-ae250180f593 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.711205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3187d849-f883-4d39-a1f9-ae250180f593 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.711205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3187d849-f883-4d39-a1f9-ae250180f593 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.711205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3187d849-f883-4d39-a1f9-ae250180f593 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.711706 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3187d849-f883-4d39-a1f9-ae250180f593 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.718307 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9f72854a-89a5-4959-adc2-0c48c65c9e0b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:07.732692 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9f72854a-89a5-4959-adc2-0c48c65c9e0b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1310 microversion: 2.1 time: 0.200378 Aug 29 23:54:07.735096 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 194/398] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:07 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1310 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:07.767396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-42b8b9f1-e95c-4e37-901d-79e2d67ce545 req-00455a46-1b66-4784-a9f2-3a86d1ac9038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bcefc4-8780-4660-ab70-6348d13dc688", "name": "network-vif-plugged", "status": "completed", "tag": "4c751dea-da0b-48df-84d7-047dd5c836e0"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:07.779407 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-42b8b9f1-e95c-4e37-901d-79e2d67ce545 req-00455a46-1b66-4784-a9f2-3a86d1ac9038 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:07.780682 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-42b8b9f1-e95c-4e37-901d-79e2d67ce545 req-00455a46-1b66-4784-a9f2-3a86d1ac9038 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:07.781417 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-42b8b9f1-e95c-4e37-901d-79e2d67ce545 req-00455a46-1b66-4784-a9f2-3a86d1ac9038 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:07.795750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-42b8b9f1-e95c-4e37-901d-79e2d67ce545 req-00455a46-1b66-4784-a9f2-3a86d1ac9038 service nova] Creating event network-vif-plugged:4c751dea-da0b-48df-84d7-047dd5c836e0 for instance 99bcefc4-8780-4660-ab70-6348d13dc688 on hv-cinder-85427 Aug 29 23:54:07.803151 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-42b8b9f1-e95c-4e37-901d-79e2d67ce545 req-00455a46-1b66-4784-a9f2-3a86d1ac9038 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041162 Aug 29 23:54:07.804058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 195/399] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:07.968525 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3187d849-f883-4d39-a1f9-ae250180f593 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:07.983383 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3187d849-f883-4d39-a1f9-ae250180f593 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1367 microversion: 2.1 time: 0.306254 Aug 29 23:54:07.985217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 205/400] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:07 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:08.195283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0cf5323e-b703-4440-8a74-8e70832e4b82 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:08.196142 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0cf5323e-b703-4440-8a74-8e70832e4b82 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:08.203401 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0cf5323e-b703-4440-8a74-8e70832e4b82 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:08.204428 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0cf5323e-b703-4440-8a74-8e70832e4b82 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:08.206733 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0cf5323e-b703-4440-8a74-8e70832e4b82 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:08.207664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0cf5323e-b703-4440-8a74-8e70832e4b82 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:08.208162 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0cf5323e-b703-4440-8a74-8e70832e4b82 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:08.209226 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0cf5323e-b703-4440-8a74-8e70832e4b82 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:08.551557 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0cf5323e-b703-4440-8a74-8e70832e4b82 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:08.551557 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0cf5323e-b703-4440-8a74-8e70832e4b82 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.326373 Aug 29 23:54:08.551557 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 196/401] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:08 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:08.642388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:08.643147 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:08.650151 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:08.650790 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:08.651310 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:08.652025 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:08.652478 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:08.652901 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:08.756056 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-381d5883-f54c-4fd8-962f-cbe69093f333 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:08.756679 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-381d5883-f54c-4fd8-962f-cbe69093f333 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:08.763975 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-381d5883-f54c-4fd8-962f-cbe69093f333 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:08.764467 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-381d5883-f54c-4fd8-962f-cbe69093f333 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:08.764903 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-381d5883-f54c-4fd8-962f-cbe69093f333 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:08.765608 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-381d5883-f54c-4fd8-962f-cbe69093f333 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:08.766060 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-381d5883-f54c-4fd8-962f-cbe69093f333 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:08.766630 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-381d5883-f54c-4fd8-962f-cbe69093f333 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:08.833580 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:08.843239 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:08.845041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:08.846288 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c9bfdcc0-24e9-4017-85be-bfae8befc86c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.207958 Aug 29 23:54:08.846950 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 206/402] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:08 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:08.851356 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-381d5883-f54c-4fd8-962f-cbe69093f333 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:08.860816 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-381d5883-f54c-4fd8-962f-cbe69093f333 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1318 microversion: 2.1 time: 0.108560 Aug 29 23:54:08.861404 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 197/403] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:08 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1318 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:09.005546 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d470050a-dc30-4529-a833-69dac2ddf54f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:09.006067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d470050a-dc30-4529-a833-69dac2ddf54f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:09.012545 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d470050a-dc30-4529-a833-69dac2ddf54f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:09.013030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d470050a-dc30-4529-a833-69dac2ddf54f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:09.013463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d470050a-dc30-4529-a833-69dac2ddf54f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:09.014286 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d470050a-dc30-4529-a833-69dac2ddf54f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:09.014820 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d470050a-dc30-4529-a833-69dac2ddf54f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:09.015239 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d470050a-dc30-4529-a833-69dac2ddf54f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:09.294626 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d470050a-dc30-4529-a833-69dac2ddf54f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:09.307845 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d470050a-dc30-4529-a833-69dac2ddf54f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1557 microversion: 2.1 time: 0.303858 Aug 29 23:54:09.308550 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 207/404] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:09 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1557 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:09.358992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2a48cc9b-9872-43fe-bdf6-86f950957d1e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:09.360343 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2a48cc9b-9872-43fe-bdf6-86f950957d1e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:09.387527 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a48cc9b-9872-43fe-bdf6-86f950957d1e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:09.389091 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a48cc9b-9872-43fe-bdf6-86f950957d1e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:09.389700 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a48cc9b-9872-43fe-bdf6-86f950957d1e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:09.395921 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a48cc9b-9872-43fe-bdf6-86f950957d1e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:09.397450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a48cc9b-9872-43fe-bdf6-86f950957d1e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:09.402962 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a48cc9b-9872-43fe-bdf6-86f950957d1e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:09.553041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4e7c1ff4-84f6-4156-81ff-a38137d40e24 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:09.560746 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4e7c1ff4-84f6-4156-81ff-a38137d40e24 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:09.606622 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c1ff4-84f6-4156-81ff-a38137d40e24 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:09.611857 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c1ff4-84f6-4156-81ff-a38137d40e24 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:09.615359 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c1ff4-84f6-4156-81ff-a38137d40e24 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:09.621254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c1ff4-84f6-4156-81ff-a38137d40e24 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:09.630976 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c1ff4-84f6-4156-81ff-a38137d40e24 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:09.632251 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c1ff4-84f6-4156-81ff-a38137d40e24 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:09.903710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2a48cc9b-9872-43fe-bdf6-86f950957d1e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.557253 Aug 29 23:54:09.905139 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 198/405] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Aug 29 23:54:09 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b/os-interface => generated 285 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:09.910989 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:09.922213 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:09.951371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:09.952150 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:09.952747 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:09.953689 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:09.954297 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:09.954926 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:10.045229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4e7c1ff4-84f6-4156-81ff-a38137d40e24 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:10.064733 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4e7c1ff4-84f6-4156-81ff-a38137d40e24 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.528852 Aug 29 23:54:10.067118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 208/406] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:09 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:10.079414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2612e8a5-8f76-41bc-af47-e97af3b57b26 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:10.082312 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2612e8a5-8f76-41bc-af47-e97af3b57b26 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:10.096089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2612e8a5-8f76-41bc-af47-e97af3b57b26 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:10.100675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2612e8a5-8f76-41bc-af47-e97af3b57b26 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:10.101181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2612e8a5-8f76-41bc-af47-e97af3b57b26 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:10.101963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2612e8a5-8f76-41bc-af47-e97af3b57b26 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:10.106223 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2612e8a5-8f76-41bc-af47-e97af3b57b26 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:10.106632 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2612e8a5-8f76-41bc-af47-e97af3b57b26 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:10.727160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:10.740770 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:10.741837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2612e8a5-8f76-41bc-af47-e97af3b57b26 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:10.745036 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:10.747498 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-bf14d6b7-edde-4864-8a9f-a24296bb4963 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.840497 Aug 29 23:54:10.753080 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2612e8a5-8f76-41bc-af47-e97af3b57b26 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.683167 Aug 29 23:54:10.765563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 209/407] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:10 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:10.765897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 199/408] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:09 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:11.113914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-88c43ba6-eba1-4e1d-a943-7f4ae9e502b5 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:11.117985 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-88c43ba6-eba1-4e1d-a943-7f4ae9e502b5 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:11.156500 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88c43ba6-eba1-4e1d-a943-7f4ae9e502b5 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:11.157892 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88c43ba6-eba1-4e1d-a943-7f4ae9e502b5 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:11.160178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88c43ba6-eba1-4e1d-a943-7f4ae9e502b5 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:11.165019 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88c43ba6-eba1-4e1d-a943-7f4ae9e502b5 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:11.169022 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88c43ba6-eba1-4e1d-a943-7f4ae9e502b5 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:11.169806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88c43ba6-eba1-4e1d-a943-7f4ae9e502b5 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:11.216281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:11.440664 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-88c43ba6-eba1-4e1d-a943-7f4ae9e502b5 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:11.455021 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-88c43ba6-eba1-4e1d-a943-7f4ae9e502b5 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1314 microversion: 2.1 time: 0.360836 Aug 29 23:54:11.455874 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 210/409] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:11 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:11.521257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-b93922bb-3244-4c7c-a300-1809cafe6091 req-e30f8424-af34-4b30-9e3c-a4eb1ff4f7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57d3d9f-7fe5-45b7-8e55-2652336c453b", "tag": "acc77992-4cc6-4366-b576-3d7fb81a0859"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:11.533089 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-b93922bb-3244-4c7c-a300-1809cafe6091 req-e30f8424-af34-4b30-9e3c-a4eb1ff4f7e9 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:11.535596 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-b93922bb-3244-4c7c-a300-1809cafe6091 req-e30f8424-af34-4b30-9e3c-a4eb1ff4f7e9 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:11.535596 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-b93922bb-3244-4c7c-a300-1809cafe6091 req-e30f8424-af34-4b30-9e3c-a4eb1ff4f7e9 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:11.551033 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-b93922bb-3244-4c7c-a300-1809cafe6091 req-e30f8424-af34-4b30-9e3c-a4eb1ff4f7e9 service nova] Creating event network-changed:acc77992-4cc6-4366-b576-3d7fb81a0859 for instance b57d3d9f-7fe5-45b7-8e55-2652336c453b on hv-cinder-85427 Aug 29 23:54:11.557185 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-b93922bb-3244-4c7c-a300-1809cafe6091 req-e30f8424-af34-4b30-9e3c-a4eb1ff4f7e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039706 Aug 29 23:54:11.557789 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 200/410] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:11.784394 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c6e165f8-b1a3-4e3d-a806-dab4db1b966b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:11.785714 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c6e165f8-b1a3-4e3d-a806-dab4db1b966b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:11.794053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:11.795909 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:11.832358 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6e165f8-b1a3-4e3d-a806-dab4db1b966b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:11.833911 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:11.834625 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:11.835344 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:11.845173 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6e165f8-b1a3-4e3d-a806-dab4db1b966b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:11.845332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:11.845332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:11.845332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:11.845702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6e165f8-b1a3-4e3d-a806-dab4db1b966b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:11.845702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6e165f8-b1a3-4e3d-a806-dab4db1b966b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:11.845702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6e165f8-b1a3-4e3d-a806-dab4db1b966b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:11.847145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6e165f8-b1a3-4e3d-a806-dab4db1b966b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:12.301981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:12.307237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c6e165f8-b1a3-4e3d-a806-dab4db1b966b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:12.311129 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:12.312896 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:12.314654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:12.315994 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ca368496-bc7e-43d0-b32e-502d6ab224f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1738 microversion: 2.20 time: 0.527763 Aug 29 23:54:12.316344 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c6e165f8-b1a3-4e3d-a806-dab4db1b966b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.536577 Aug 29 23:54:12.322515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 201/411] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:11 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1738 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:12.331116 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-b5a4ad6a-8c1d-4971-874d-1dd45cc44bc7 req-a034692a-dcba-4f5c-8702-b8c276b5b4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80567224-9d47-4087-b154-85564c2987cd", "tag": "4bfeae22-1324-4d1f-9b5f-0d481c03c512"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:12.338965 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 211/412] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:11 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:12.343087 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-b5a4ad6a-8c1d-4971-874d-1dd45cc44bc7 req-a034692a-dcba-4f5c-8702-b8c276b5b4e5 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:12.343721 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-b5a4ad6a-8c1d-4971-874d-1dd45cc44bc7 req-a034692a-dcba-4f5c-8702-b8c276b5b4e5 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:12.344595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-b5a4ad6a-8c1d-4971-874d-1dd45cc44bc7 req-a034692a-dcba-4f5c-8702-b8c276b5b4e5 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:12.358463 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-b5a4ad6a-8c1d-4971-874d-1dd45cc44bc7 req-a034692a-dcba-4f5c-8702-b8c276b5b4e5 service nova] Creating event network-changed:4bfeae22-1324-4d1f-9b5f-0d481c03c512 for instance 80567224-9d47-4087-b154-85564c2987cd on hv-cinder-85427 Aug 29 23:54:12.363194 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-b5a4ad6a-8c1d-4971-874d-1dd45cc44bc7 req-a034692a-dcba-4f5c-8702-b8c276b5b4e5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045168 Aug 29 23:54:12.364122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 202/413] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:12.478661 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-90c3631e-3cd2-494e-8e14-8d5ec79519ba tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:12.479665 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-90c3631e-3cd2-494e-8e14-8d5ec79519ba tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:12.481934 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=6 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:12.487260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-90c3631e-3cd2-494e-8e14-8d5ec79519ba tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:12.487756 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-90c3631e-3cd2-494e-8e14-8d5ec79519ba tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:12.488403 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-90c3631e-3cd2-494e-8e14-8d5ec79519ba tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:12.489113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-90c3631e-3cd2-494e-8e14-8d5ec79519ba tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:12.489554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-90c3631e-3cd2-494e-8e14-8d5ec79519ba tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:12.490135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-90c3631e-3cd2-494e-8e14-8d5ec79519ba tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:12.714701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-90c3631e-3cd2-494e-8e14-8d5ec79519ba tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:12.723755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-90c3631e-3cd2-494e-8e14-8d5ec79519ba tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1498 microversion: 2.1 time: 0.249880 Aug 29 23:54:12.724651 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 212/414] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:12 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1498 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:13.341429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:13.342690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:13.343526 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-63c8942f-3560-4fea-8ba8-3abc96f244f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:13.344429 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-63c8942f-3560-4fea-8ba8-3abc96f244f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:13.357409 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-63c8942f-3560-4fea-8ba8-3abc96f244f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:13.357898 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-63c8942f-3560-4fea-8ba8-3abc96f244f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:13.358458 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-63c8942f-3560-4fea-8ba8-3abc96f244f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:13.362633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-63c8942f-3560-4fea-8ba8-3abc96f244f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:13.363189 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-63c8942f-3560-4fea-8ba8-3abc96f244f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:13.363387 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:13.363625 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-63c8942f-3560-4fea-8ba8-3abc96f244f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:13.364004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:13.365467 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:13.367949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:13.371493 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:13.372106 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:13.683266 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-63c8942f-3560-4fea-8ba8-3abc96f244f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:13.692285 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-63c8942f-3560-4fea-8ba8-3abc96f244f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.352561 Aug 29 23:54:13.693158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 213/415] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:13 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:13.700958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:13.724331 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:13.726033 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:13.728845 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-47969efa-c51e-4bc8-a1d8-8ec160ab93fc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.392828 Aug 29 23:54:13.729994 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 203/416] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:13 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:14.103801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-94bbb982-ec13-44d9-9abe-a0a7827f7a9d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:14.104299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-94bbb982-ec13-44d9-9abe-a0a7827f7a9d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:14.116137 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94bbb982-ec13-44d9-9abe-a0a7827f7a9d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:14.116732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94bbb982-ec13-44d9-9abe-a0a7827f7a9d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:14.117390 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94bbb982-ec13-44d9-9abe-a0a7827f7a9d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:14.118176 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94bbb982-ec13-44d9-9abe-a0a7827f7a9d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:14.118659 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94bbb982-ec13-44d9-9abe-a0a7827f7a9d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:14.119087 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94bbb982-ec13-44d9-9abe-a0a7827f7a9d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:14.149585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-94bbb982-ec13-44d9-9abe-a0a7827f7a9d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:54:14.724103 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e71b3f7f-6d15-4c41-a8aa-86e4f8c212c3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:14.725313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e71b3f7f-6d15-4c41-a8aa-86e4f8c212c3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:14.727581 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=8 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:14.735652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e71b3f7f-6d15-4c41-a8aa-86e4f8c212c3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:14.736152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e71b3f7f-6d15-4c41-a8aa-86e4f8c212c3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:14.736742 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e71b3f7f-6d15-4c41-a8aa-86e4f8c212c3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:14.737688 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e71b3f7f-6d15-4c41-a8aa-86e4f8c212c3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:14.738159 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e71b3f7f-6d15-4c41-a8aa-86e4f8c212c3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:14.738623 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e71b3f7f-6d15-4c41-a8aa-86e4f8c212c3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:14.756982 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:14.790551 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-94bbb982-ec13-44d9-9abe-a0a7827f7a9d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 204 len: 0 microversion: 2.1 time: 0.690619 Aug 29 23:54:14.800520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 214/417] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:54:14 2022] DELETE /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:54:14.801956 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:14.805791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:14.817139 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:14.817919 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:14.818573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:14.819741 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:14.822133 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:14.822721 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:15.093609 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e71b3f7f-6d15-4c41-a8aa-86e4f8c212c3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:15.104743 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e71b3f7f-6d15-4c41-a8aa-86e4f8c212c3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.385825 Aug 29 23:54:15.106381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 204/418] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:14 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:15.113241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f03b4d93-d9be-4203-973b-17d2c1c3b037 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:15.114938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f03b4d93-d9be-4203-973b-17d2c1c3b037 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:15.126464 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f03b4d93-d9be-4203-973b-17d2c1c3b037 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:15.127436 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f03b4d93-d9be-4203-973b-17d2c1c3b037 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:15.128043 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f03b4d93-d9be-4203-973b-17d2c1c3b037 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:15.129900 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f03b4d93-d9be-4203-973b-17d2c1c3b037 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:15.130635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f03b4d93-d9be-4203-973b-17d2c1c3b037 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:15.131206 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f03b4d93-d9be-4203-973b-17d2c1c3b037 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:15.132796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:15.144459 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:15.145969 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:15.147217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e92ae7d4-1521-445a-b864-e6df7d2f5478 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.349862 Aug 29 23:54:15.147759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 215/419] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:14 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:15.333870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f03b4d93-d9be-4203-973b-17d2c1c3b037 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:15.349159 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f03b4d93-d9be-4203-973b-17d2c1c3b037 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1504 microversion: 2.1 time: 0.241421 Aug 29 23:54:15.378942 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 205/420] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:15 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:15.629994 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-5a7ff675-83af-41ec-9d43-d7a4a730e1c3 req-c20a1342-3ab3-4a9e-b085-ad04a9ddf1af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781bf4fc-f6e6-4efc-b757-5888339b6b3c", "name": "network-vif-unplugged", "status": "completed", "tag": "70011c53-2246-46a9-9308-734ee213614a"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:15.657554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-5a7ff675-83af-41ec-9d43-d7a4a730e1c3 req-c20a1342-3ab3-4a9e-b085-ad04a9ddf1af service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:15.658047 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-5a7ff675-83af-41ec-9d43-d7a4a730e1c3 req-c20a1342-3ab3-4a9e-b085-ad04a9ddf1af service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:15.658517 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-5a7ff675-83af-41ec-9d43-d7a4a730e1c3 req-c20a1342-3ab3-4a9e-b085-ad04a9ddf1af service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:15.671789 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-5a7ff675-83af-41ec-9d43-d7a4a730e1c3 req-c20a1342-3ab3-4a9e-b085-ad04a9ddf1af service nova] Creating event network-vif-unplugged:70011c53-2246-46a9-9308-734ee213614a for instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c on hv-cinder-85427 Aug 29 23:54:15.682846 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-5a7ff675-83af-41ec-9d43-d7a4a730e1c3 req-c20a1342-3ab3-4a9e-b085-ad04a9ddf1af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060722 Aug 29 23:54:15.684355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 216/421] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:16.125412 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7debd7af-5303-4184-be14-6f441475e725 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:16.126150 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7debd7af-5303-4184-be14-6f441475e725 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:16.136139 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7debd7af-5303-4184-be14-6f441475e725 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.136787 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7debd7af-5303-4184-be14-6f441475e725 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.137325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7debd7af-5303-4184-be14-6f441475e725 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.138195 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7debd7af-5303-4184-be14-6f441475e725 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.138787 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7debd7af-5303-4184-be14-6f441475e725 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.139386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7debd7af-5303-4184-be14-6f441475e725 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.177860 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:16.178627 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:16.186196 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.187013 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.187625 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.188571 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.189223 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.189698 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.462775 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7debd7af-5303-4184-be14-6f441475e725 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:16.478301 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7debd7af-5303-4184-be14-6f441475e725 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.356823 Aug 29 23:54:16.492906 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 206/422] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:16 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:16.497753 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:16.499301 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9f8e1aff-d6d0-4f04-95d9-eae5c1503c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:16.500443 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9f8e1aff-d6d0-4f04-95d9-eae5c1503c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:16.507575 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:16.510149 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:16.510704 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f8e1aff-d6d0-4f04-95d9-eae5c1503c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.511467 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8a0b8b8d-fee2-4020-b605-21d32f1a7164 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.339207 Aug 29 23:54:16.511880 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f8e1aff-d6d0-4f04-95d9-eae5c1503c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.512598 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f8e1aff-d6d0-4f04-95d9-eae5c1503c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.513671 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f8e1aff-d6d0-4f04-95d9-eae5c1503c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:16.514461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f8e1aff-d6d0-4f04-95d9-eae5c1503c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:16.514974 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f8e1aff-d6d0-4f04-95d9-eae5c1503c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:16.522982 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 217/423] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:16 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:16.697243 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9f8e1aff-d6d0-4f04-95d9-eae5c1503c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:16.706154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9f8e1aff-d6d0-4f04-95d9-eae5c1503c2f tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1504 microversion: 2.1 time: 0.211629 Aug 29 23:54:16.706762 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 207/424] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:16 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:17.502737 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-80f92eb9-86c5-423e-9e94-117ec1ed08f9 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:17.504586 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-80f92eb9-86c5-423e-9e94-117ec1ed08f9 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:17.514310 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-80f92eb9-86c5-423e-9e94-117ec1ed08f9 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:17.514990 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-80f92eb9-86c5-423e-9e94-117ec1ed08f9 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:17.515420 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-80f92eb9-86c5-423e-9e94-117ec1ed08f9 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:17.516136 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-80f92eb9-86c5-423e-9e94-117ec1ed08f9 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:17.516584 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-80f92eb9-86c5-423e-9e94-117ec1ed08f9 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:17.517059 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-80f92eb9-86c5-423e-9e94-117ec1ed08f9 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:17.540991 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:17.542309 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:17.550381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:17.550884 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:17.551360 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:17.552136 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:17.552605 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:17.553082 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:17.866449 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-80f92eb9-86c5-423e-9e94-117ec1ed08f9 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:17.880988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-80f92eb9-86c5-423e-9e94-117ec1ed08f9 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.383898 Aug 29 23:54:17.886276 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 218/425] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:17 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:17.891471 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1a578361-59b6-437d-96a0-862dcdcd605d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:17.902771 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1a578361-59b6-437d-96a0-862dcdcd605d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:17.904276 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:17.910325 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a578361-59b6-437d-96a0-862dcdcd605d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:17.911073 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a578361-59b6-437d-96a0-862dcdcd605d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:17.911607 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a578361-59b6-437d-96a0-862dcdcd605d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:17.912342 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a578361-59b6-437d-96a0-862dcdcd605d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:17.912792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a578361-59b6-437d-96a0-862dcdcd605d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:17.913228 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a578361-59b6-437d-96a0-862dcdcd605d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:17.913962 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:17.915473 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:17.916668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8991e440-33ca-499b-b897-7f2fe6916bd2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.384286 Aug 29 23:54:17.917241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 208/426] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:17 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:18.076879 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1a578361-59b6-437d-96a0-862dcdcd605d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:18.094447 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1a578361-59b6-437d-96a0-862dcdcd605d tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1504 microversion: 2.1 time: 0.205858 Aug 29 23:54:18.095945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 219/427] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:17 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:18.911139 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2a2d314f-a011-426a-ac8b-e4f6f9a73479 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:18.912199 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2a2d314f-a011-426a-ac8b-e4f6f9a73479 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:18.921580 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2d314f-a011-426a-ac8b-e4f6f9a73479 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:18.922068 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2d314f-a011-426a-ac8b-e4f6f9a73479 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:18.922537 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2d314f-a011-426a-ac8b-e4f6f9a73479 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:18.923353 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2d314f-a011-426a-ac8b-e4f6f9a73479 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:18.924316 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2d314f-a011-426a-ac8b-e4f6f9a73479 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:18.924735 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2d314f-a011-426a-ac8b-e4f6f9a73479 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:18.942717 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:18.943338 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:18.952672 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:18.953261 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:18.953905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:18.954869 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:18.955363 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:18.955796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:19.183843 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2a2d314f-a011-426a-ac8b-e4f6f9a73479 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:19.189362 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:19.193864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2a2d314f-a011-426a-ac8b-e4f6f9a73479 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.289561 Aug 29 23:54:19.194702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 209/428] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:18 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:19.207878 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-753efcf3-dd13-4d66-be6f-e43daae5a4fb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:19.208411 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-753efcf3-dd13-4d66-be6f-e43daae5a4fb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:19.213761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:19.217200 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:19.219773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-dc1a8d22-4928-4f53-8a6c-6cea2dbc4beb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.281078 Aug 29 23:54:19.222604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 220/429] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:18 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:19.233112 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-753efcf3-dd13-4d66-be6f-e43daae5a4fb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:19.233628 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-753efcf3-dd13-4d66-be6f-e43daae5a4fb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:19.234065 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-753efcf3-dd13-4d66-be6f-e43daae5a4fb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:19.234925 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-753efcf3-dd13-4d66-be6f-e43daae5a4fb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:19.235570 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-753efcf3-dd13-4d66-be6f-e43daae5a4fb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:19.236169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-753efcf3-dd13-4d66-be6f-e43daae5a4fb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:19.465058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-753efcf3-dd13-4d66-be6f-e43daae5a4fb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:19.475322 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-753efcf3-dd13-4d66-be6f-e43daae5a4fb tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1504 microversion: 2.1 time: 0.275122 Aug 29 23:54:19.478332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 210/430] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:19 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:20.217398 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5b8ec5c0-b36c-407f-becd-9f9ae8721186 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:20.219264 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-5b8ec5c0-b36c-407f-becd-9f9ae8721186 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:20.227722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5c0-b36c-407f-becd-9f9ae8721186 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.228390 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5c0-b36c-407f-becd-9f9ae8721186 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.229147 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5c0-b36c-407f-becd-9f9ae8721186 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.230004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5c0-b36c-407f-becd-9f9ae8721186 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.230703 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5c0-b36c-407f-becd-9f9ae8721186 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.231368 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5b8ec5c0-b36c-407f-becd-9f9ae8721186 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.250742 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:20.251620 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:20.260461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.260955 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.261392 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.262290 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.262886 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.263714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.533919 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5b8ec5c0-b36c-407f-becd-9f9ae8721186 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:20.546942 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5b8ec5c0-b36c-407f-becd-9f9ae8721186 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.334449 Aug 29 23:54:20.547601 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 221/431] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:20 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:20.557462 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fcf562f5-dfc7-40ba-ae53-cd6e30879cf1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:20.557462 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fcf562f5-dfc7-40ba-ae53-cd6e30879cf1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:20.578344 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:20.595440 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fcf562f5-dfc7-40ba-ae53-cd6e30879cf1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.597846 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fcf562f5-dfc7-40ba-ae53-cd6e30879cf1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.597846 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fcf562f5-dfc7-40ba-ae53-cd6e30879cf1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.599082 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fcf562f5-dfc7-40ba-ae53-cd6e30879cf1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:20.600019 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fcf562f5-dfc7-40ba-ae53-cd6e30879cf1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:20.600338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:20.600991 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fcf562f5-dfc7-40ba-ae53-cd6e30879cf1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:20.603290 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:20.604806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3c5661ff-db56-4e42-8ac0-bdddd64bd16e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.358506 Aug 29 23:54:20.605893 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 211/432] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:20 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:20.830272 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fcf562f5-dfc7-40ba-ae53-cd6e30879cf1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:20.845572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fcf562f5-dfc7-40ba-ae53-cd6e30879cf1 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1504 microversion: 2.1 time: 0.296741 Aug 29 23:54:20.866455 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 222/433] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:20 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:21.593662 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7d100710-3cd0-4c83-9eb2-12345ed9546f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:21.594796 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7d100710-3cd0-4c83-9eb2-12345ed9546f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:21.602502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d100710-3cd0-4c83-9eb2-12345ed9546f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:21.602953 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d100710-3cd0-4c83-9eb2-12345ed9546f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:21.603415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d100710-3cd0-4c83-9eb2-12345ed9546f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:21.604121 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d100710-3cd0-4c83-9eb2-12345ed9546f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:21.604936 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d100710-3cd0-4c83-9eb2-12345ed9546f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:21.605072 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d100710-3cd0-4c83-9eb2-12345ed9546f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:21.659931 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:21.661216 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:21.674261 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:21.675562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:21.677881 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:21.680146 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:21.681020 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:21.681817 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:21.888161 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7d100710-3cd0-4c83-9eb2-12345ed9546f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:21.908441 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7d100710-3cd0-4c83-9eb2-12345ed9546f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.313693 Aug 29 23:54:21.909636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 212/434] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:21 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:21.924670 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-efdc408f-fcc0-42b7-85de-8fe88c1163ff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:21.926274 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-efdc408f-fcc0-42b7-85de-8fe88c1163ff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:21.936771 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efdc408f-fcc0-42b7-85de-8fe88c1163ff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:21.937260 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efdc408f-fcc0-42b7-85de-8fe88c1163ff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:21.937696 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efdc408f-fcc0-42b7-85de-8fe88c1163ff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:21.938482 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efdc408f-fcc0-42b7-85de-8fe88c1163ff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:21.938942 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efdc408f-fcc0-42b7-85de-8fe88c1163ff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:21.939371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efdc408f-fcc0-42b7-85de-8fe88c1163ff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:21.942315 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:21.951177 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:21.952870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:21.954205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7e1f1f31-75de-4640-b3ce-d7d856b4e37b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.314986 Aug 29 23:54:21.955432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 223/435] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:21 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:22.094398 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-efdc408f-fcc0-42b7-85de-8fe88c1163ff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:22.102044 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-efdc408f-fcc0-42b7-85de-8fe88c1163ff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1504 microversion: 2.1 time: 0.190174 Aug 29 23:54:22.102752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 213/436] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:21 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:22.932279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-cd4fa682-24f2-4c66-9335-64d105ed9dbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:22.932932 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-cd4fa682-24f2-4c66-9335-64d105ed9dbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:22.939820 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd4fa682-24f2-4c66-9335-64d105ed9dbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:22.940308 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd4fa682-24f2-4c66-9335-64d105ed9dbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:22.940735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd4fa682-24f2-4c66-9335-64d105ed9dbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:22.941500 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd4fa682-24f2-4c66-9335-64d105ed9dbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:22.941999 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd4fa682-24f2-4c66-9335-64d105ed9dbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:22.942535 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd4fa682-24f2-4c66-9335-64d105ed9dbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.000612 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:23.001376 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:23.010053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:23.010053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:23.010053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.010623 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:23.011110 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:23.011636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.135329 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-cd4fa682-24f2-4c66-9335-64d105ed9dbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:23.144611 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-cd4fa682-24f2-4c66-9335-64d105ed9dbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.216814 Aug 29 23:54:23.145660 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 224/437] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:22 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:23.155973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-147bf078-13ab-473e-9b7e-05ed7d04a8d9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:23.157203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-147bf078-13ab-473e-9b7e-05ed7d04a8d9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:23.168933 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-147bf078-13ab-473e-9b7e-05ed7d04a8d9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:23.169801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-147bf078-13ab-473e-9b7e-05ed7d04a8d9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:23.170638 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-147bf078-13ab-473e-9b7e-05ed7d04a8d9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.171919 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-147bf078-13ab-473e-9b7e-05ed7d04a8d9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:23.172585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-147bf078-13ab-473e-9b7e-05ed7d04a8d9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:23.173282 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-147bf078-13ab-473e-9b7e-05ed7d04a8d9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:23.231700 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:23.264558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:23.269640 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:23.269961 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e239b8b7-3451-4d48-a044-f7be38ca44bb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.272954 Aug 29 23:54:23.284588 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 214/438] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:22 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:23.411043 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-147bf078-13ab-473e-9b7e-05ed7d04a8d9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:23.422520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-147bf078-13ab-473e-9b7e-05ed7d04a8d9 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1504 microversion: 2.1 time: 0.275359 Aug 29 23:54:23.423109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 225/439] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:23 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:24.177491 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-12ebf42f-5f2b-4ec9-b38b-5b1d4428730a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:24.178043 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-12ebf42f-5f2b-4ec9-b38b-5b1d4428730a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:24.189089 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-12ebf42f-5f2b-4ec9-b38b-5b1d4428730a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.189954 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-12ebf42f-5f2b-4ec9-b38b-5b1d4428730a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.190766 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-12ebf42f-5f2b-4ec9-b38b-5b1d4428730a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.192029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-12ebf42f-5f2b-4ec9-b38b-5b1d4428730a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.192705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-12ebf42f-5f2b-4ec9-b38b-5b1d4428730a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.193481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-12ebf42f-5f2b-4ec9-b38b-5b1d4428730a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.319025 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:24.320335 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:24.328616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.329217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.329692 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.330453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.330915 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.331337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.337155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:24.368546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-12ebf42f-5f2b-4ec9-b38b-5b1d4428730a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:24.379880 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-12ebf42f-5f2b-4ec9-b38b-5b1d4428730a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.206871 Aug 29 23:54:24.380570 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 215/440] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:24 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:24.444732 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-90e8fdec-25e2-4eae-a928-00c3ded8fbff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:24.445432 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-90e8fdec-25e2-4eae-a928-00c3ded8fbff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:24.451860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90e8fdec-25e2-4eae-a928-00c3ded8fbff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.452345 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90e8fdec-25e2-4eae-a928-00c3ded8fbff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.452774 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90e8fdec-25e2-4eae-a928-00c3ded8fbff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.453486 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90e8fdec-25e2-4eae-a928-00c3ded8fbff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:24.453940 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90e8fdec-25e2-4eae-a928-00c3ded8fbff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:24.454363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90e8fdec-25e2-4eae-a928-00c3ded8fbff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:24.488964 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:24.500375 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:24.526626 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:24.526626 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-82527a83-0653-4570-9c0e-b16c87b90243 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.188809 Aug 29 23:54:24.526626 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 226/441] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:24 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:24.610312 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-90e8fdec-25e2-4eae-a928-00c3ded8fbff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:24.618931 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-90e8fdec-25e2-4eae-a928-00c3ded8fbff tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1504 microversion: 2.1 time: 0.178105 Aug 29 23:54:24.619517 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 216/442] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:24 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:25.414043 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4e7c2599-4278-4145-b90a-6ccf89d8a6a7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:25.414933 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4e7c2599-4278-4145-b90a-6ccf89d8a6a7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:25.422466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c2599-4278-4145-b90a-6ccf89d8a6a7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:25.423480 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c2599-4278-4145-b90a-6ccf89d8a6a7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:25.423480 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c2599-4278-4145-b90a-6ccf89d8a6a7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:25.424573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c2599-4278-4145-b90a-6ccf89d8a6a7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:25.425570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c2599-4278-4145-b90a-6ccf89d8a6a7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:25.425570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4e7c2599-4278-4145-b90a-6ccf89d8a6a7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:25.543338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:25.544225 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:25.551536 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:25.557351 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:25.557351 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:25.557351 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:25.557351 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:25.558056 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:26.119784 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4e7c2599-4278-4145-b90a-6ccf89d8a6a7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:26.136789 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4e7c2599-4278-4145-b90a-6ccf89d8a6a7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.730516 Aug 29 23:54:26.150999 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 227/443] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:25 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:26.172566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1bf447e4-bc68-42fd-8a1d-25b4101110ce tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:26.173675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1bf447e4-bc68-42fd-8a1d-25b4101110ce tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:26.192629 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1bf447e4-bc68-42fd-8a1d-25b4101110ce tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:26.193175 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1bf447e4-bc68-42fd-8a1d-25b4101110ce tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:26.193747 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1bf447e4-bc68-42fd-8a1d-25b4101110ce tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:26.194448 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1bf447e4-bc68-42fd-8a1d-25b4101110ce tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:26.195169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1bf447e4-bc68-42fd-8a1d-25b4101110ce tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:26.195658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1bf447e4-bc68-42fd-8a1d-25b4101110ce tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:26.202366 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:26.215461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:26.217268 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:26.218724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7f4e1894-7711-4b0a-b05e-a22bd74bed92 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.682014 Aug 29 23:54:26.219925 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 217/444] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:25 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:26.300736 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1bf447e4-bc68-42fd-8a1d-25b4101110ce tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:26.310494 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-3fa752d9-52cd-464a-a7b4-bd8cfb828c90 req-9a7d928f-6dfb-4f7d-8628-3eba336b8116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bcefc4-8780-4660-ab70-6348d13dc688", "name": "network-vif-deleted", "tag": "4c751dea-da0b-48df-84d7-047dd5c836e0"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:26.314105 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1bf447e4-bc68-42fd-8a1d-25b4101110ce tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1462 microversion: 2.1 time: 0.161414 Aug 29 23:54:26.314891 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 228/445] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:26 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1462 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:26.321632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-3fa752d9-52cd-464a-a7b4-bd8cfb828c90 req-9a7d928f-6dfb-4f7d-8628-3eba336b8116 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:26.322530 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-3fa752d9-52cd-464a-a7b4-bd8cfb828c90 req-9a7d928f-6dfb-4f7d-8628-3eba336b8116 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:26.323036 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-3fa752d9-52cd-464a-a7b4-bd8cfb828c90 req-9a7d928f-6dfb-4f7d-8628-3eba336b8116 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:26.337017 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-3fa752d9-52cd-464a-a7b4-bd8cfb828c90 req-9a7d928f-6dfb-4f7d-8628-3eba336b8116 service nova] Creating event network-vif-deleted:4c751dea-da0b-48df-84d7-047dd5c836e0 for instance 99bcefc4-8780-4660-ab70-6348d13dc688 on hv-cinder-85427 Aug 29 23:54:26.349926 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-3fa752d9-52cd-464a-a7b4-bd8cfb828c90 req-9a7d928f-6dfb-4f7d-8628-3eba336b8116 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036411 Aug 29 23:54:26.350652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 218/446] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:54:27.172178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-102f1055-72a5-4518-bf38-720409563dad tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:27.172796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-102f1055-72a5-4518-bf38-720409563dad tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:27.180452 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-102f1055-72a5-4518-bf38-720409563dad tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.182628 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-102f1055-72a5-4518-bf38-720409563dad tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.182628 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-102f1055-72a5-4518-bf38-720409563dad tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.182628 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-102f1055-72a5-4518-bf38-720409563dad tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.183109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-102f1055-72a5-4518-bf38-720409563dad tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.183522 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-102f1055-72a5-4518-bf38-720409563dad tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.246035 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:27.246671 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:27.253786 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.254481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.261656 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.261656 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.261656 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.261656 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.432148 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-102f1055-72a5-4518-bf38-720409563dad tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:27.447848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-102f1055-72a5-4518-bf38-720409563dad tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.279260 Aug 29 23:54:27.450694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 229/447] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:27 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:27.457327 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8609b14f-0f5f-4db3-bf24-a71dfb72fbc2 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:27.458464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8609b14f-0f5f-4db3-bf24-a71dfb72fbc2 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:27.469760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8609b14f-0f5f-4db3-bf24-a71dfb72fbc2 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.470710 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8609b14f-0f5f-4db3-bf24-a71dfb72fbc2 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.470994 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8609b14f-0f5f-4db3-bf24-a71dfb72fbc2 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.472466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8609b14f-0f5f-4db3-bf24-a71dfb72fbc2 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.473285 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8609b14f-0f5f-4db3-bf24-a71dfb72fbc2 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.474567 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8609b14f-0f5f-4db3-bf24-a71dfb72fbc2 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.601294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8609b14f-0f5f-4db3-bf24-a71dfb72fbc2 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:27.607632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:27.610300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8609b14f-0f5f-4db3-bf24-a71dfb72fbc2 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1299 microversion: 2.1 time: 0.160024 Aug 29 23:54:27.610934 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 230/448] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:27 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:27.617501 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5070b4d6-0e7f-4989-9e65-746c0546a5e1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:27.617501 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-5070b4d6-0e7f-4989-9e65-746c0546a5e1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:27.624230 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5070b4d6-0e7f-4989-9e65-746c0546a5e1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.624511 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:27.624799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5070b4d6-0e7f-4989-9e65-746c0546a5e1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.625369 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5070b4d6-0e7f-4989-9e65-746c0546a5e1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.626089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5070b4d6-0e7f-4989-9e65-746c0546a5e1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:27.626644 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5070b4d6-0e7f-4989-9e65-746c0546a5e1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:27.627161 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5070b4d6-0e7f-4989-9e65-746c0546a5e1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:27.627405 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:27.628853 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c3d48f99-93ac-4a63-b1f5-c6410b41d94e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.387888 Aug 29 23:54:27.641849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 219/449] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:27 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:27.761705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-5070b4d6-0e7f-4989-9e65-746c0546a5e1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lazy-loading 'services' on Instance uuid 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:54:28.039604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5070b4d6-0e7f-4989-9e65-746c0546a5e1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/os-volume_attachments/fcf83db6-2525-4de3-bed0-37b66231b23c" status: 202 len: 0 microversion: 2.1 time: 0.426378 Aug 29 23:54:28.040118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 231/450] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Aug 29 23:54:27 2022] DELETE /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/os-volume_attachments/fcf83db6-2525-4de3-bed0-37b66231b23c => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:54:28.470122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d607331a-dc3d-402e-b6fc-094c5d3e0ca7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:28.470828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d607331a-dc3d-402e-b6fc-094c5d3e0ca7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:28.481067 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d607331a-dc3d-402e-b6fc-094c5d3e0ca7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.481067 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d607331a-dc3d-402e-b6fc-094c5d3e0ca7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.481067 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d607331a-dc3d-402e-b6fc-094c5d3e0ca7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.481067 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d607331a-dc3d-402e-b6fc-094c5d3e0ca7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.481541 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d607331a-dc3d-402e-b6fc-094c5d3e0ca7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.481541 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d607331a-dc3d-402e-b6fc-094c5d3e0ca7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.645075 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d607331a-dc3d-402e-b6fc-094c5d3e0ca7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:28.648977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-cb82c558-22c7-4ccd-87f1-5fa493b7fa37 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:28.649740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-cb82c558-22c7-4ccd-87f1-5fa493b7fa37 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:28.654344 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d607331a-dc3d-402e-b6fc-094c5d3e0ca7 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.188462 Aug 29 23:54:28.654993 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 220/451] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:28 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:28.656428 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cb82c558-22c7-4ccd-87f1-5fa493b7fa37 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.656918 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cb82c558-22c7-4ccd-87f1-5fa493b7fa37 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.657342 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cb82c558-22c7-4ccd-87f1-5fa493b7fa37 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.658042 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cb82c558-22c7-4ccd-87f1-5fa493b7fa37 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.658503 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cb82c558-22c7-4ccd-87f1-5fa493b7fa37 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.659185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cb82c558-22c7-4ccd-87f1-5fa493b7fa37 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.660288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:28.660912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:28.670256 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.671135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.671750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.672652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:28.673097 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:28.673529 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:28.756432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-cb82c558-22c7-4ccd-87f1-5fa493b7fa37 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:28.766505 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-cb82c558-22c7-4ccd-87f1-5fa493b7fa37 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1299 microversion: 2.1 time: 0.122845 Aug 29 23:54:28.767112 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 232/452] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:28 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:28.859531 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:28.861920 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:28.869771 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:28.871395 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:28.872630 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-595c533e-6327-41f4-9c26-99cb755999af tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.216498 Aug 29 23:54:28.873202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 221/453] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:28 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:29.681401 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-37f41a3d-73dc-4896-be12-4bc25d483f46 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:29.682075 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-37f41a3d-73dc-4896-be12-4bc25d483f46 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:29.690475 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37f41a3d-73dc-4896-be12-4bc25d483f46 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.691031 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37f41a3d-73dc-4896-be12-4bc25d483f46 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.691536 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37f41a3d-73dc-4896-be12-4bc25d483f46 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.692347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37f41a3d-73dc-4896-be12-4bc25d483f46 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.692814 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37f41a3d-73dc-4896-be12-4bc25d483f46 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.693249 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37f41a3d-73dc-4896-be12-4bc25d483f46 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.791221 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:29.792041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:29.800433 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.801048 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.801618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.802543 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.803126 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.803664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.857656 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.858807 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.859586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.860416 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lazy-loading 'fault' on Instance uuid 99bcefc4-8780-4660-ab70-6348d13dc688 {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:54:29.873207 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-37f41a3d-73dc-4896-be12-4bc25d483f46 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:29.888531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-37f41a3d-73dc-4896-be12-4bc25d483f46 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.211398 Aug 29 23:54:29.889885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 233/454] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:29 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:29.906460 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:29.906809 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:29.912254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:29.917607 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.918279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.918944 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.919899 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:29.920455 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:29.920924 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:29.936581 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:29.945464 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-19ae57ec-ef6c-43ee-a810-a4ab72dbe558 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1304 microversion: 2.1 time: 0.158546 Aug 29 23:54:29.946047 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 222/455] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:29 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:30.084772 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:30.102595 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:30.105556 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:30.107837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-089fa5c4-61ab-4ab7-adf3-78a52b4da165 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.214232 Aug 29 23:54:30.108813 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 234/456] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:29 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:30.919999 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8bb03015-32b7-4f3b-9376-afcd62c1d754 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:30.920676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8bb03015-32b7-4f3b-9376-afcd62c1d754 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:30.928516 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bb03015-32b7-4f3b-9376-afcd62c1d754 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.929117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bb03015-32b7-4f3b-9376-afcd62c1d754 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.929715 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bb03015-32b7-4f3b-9376-afcd62c1d754 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:30.931016 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bb03015-32b7-4f3b-9376-afcd62c1d754 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.931560 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bb03015-32b7-4f3b-9376-afcd62c1d754 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.932024 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bb03015-32b7-4f3b-9376-afcd62c1d754 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:30.969603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:30.970719 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:30.983610 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.984435 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.995454 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:30.995454 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:30.995454 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:30.995454 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:31.051587 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:31.052070 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:31.052492 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:31.052960 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lazy-loading 'fault' on Instance uuid 99bcefc4-8780-4660-ab70-6348d13dc688 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:54:31.119617 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.129274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c7df142e-2b7a-4601-8b7b-74b0657487e0 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1304 microversion: 2.1 time: 0.164228 Aug 29 23:54:31.130130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 235/457] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:30 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1304 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:31.143658 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8bb03015-32b7-4f3b-9376-afcd62c1d754 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.153875 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:31.154600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:31.157564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8bb03015-32b7-4f3b-9376-afcd62c1d754 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.242483 Aug 29 23:54:31.162832 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:31.164464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:31.164464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:31.165158 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 223/458] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:30 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:31.165489 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:31.166071 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:31.166855 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:31.342786 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.353170 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.354676 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:31.355864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2634b732-7a18-4eb8-aa96-8afd869effad tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.212011 Aug 29 23:54:31.356463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 236/459] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:31 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:32.161698 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:32.162785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:32.167286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=89 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:32.173310 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.173795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.174233 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.174985 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.175430 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.176469 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.189336 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e82fd168-c4ab-44f7-a0f0-9f6bb15c5d7a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:32.191515 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e82fd168-c4ab-44f7-a0f0-9f6bb15c5d7a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:32.203777 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e82fd168-c4ab-44f7-a0f0-9f6bb15c5d7a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.204878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e82fd168-c4ab-44f7-a0f0-9f6bb15c5d7a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.205973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e82fd168-c4ab-44f7-a0f0-9f6bb15c5d7a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.207562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e82fd168-c4ab-44f7-a0f0-9f6bb15c5d7a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.208430 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e82fd168-c4ab-44f7-a0f0-9f6bb15c5d7a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.209171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e82fd168-c4ab-44f7-a0f0-9f6bb15c5d7a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.216850 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.217425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.217927 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.218942 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lazy-loading 'fault' on Instance uuid 99bcefc4-8780-4660-ab70-6348d13dc688 {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:54:32.270142 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.280129 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b6ad1c90-aba4-4e49-9a70-6a9bfa5d6204 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1304 microversion: 2.1 time: 0.122814 Aug 29 23:54:32.280986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 224/460] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:32 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1304 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:32.385334 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:32.386391 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:32.411418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.413181 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.413865 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.414799 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:32.415426 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:32.416011 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:32.464453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e82fd168-c4ab-44f7-a0f0-9f6bb15c5d7a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.478005 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e82fd168-c4ab-44f7-a0f0-9f6bb15c5d7a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.294270 Aug 29 23:54:32.478977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 237/461] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:32 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:32.689967 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.699591 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.701479 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:32.703050 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-49b07e24-7118-40d7-9538-b32dd516ff67 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1720 microversion: 2.20 time: 0.326004 Aug 29 23:54:32.703623 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 225/462] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:32 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1720 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:33.303164 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:33.304027 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:33.311978 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.312511 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.312897 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.313653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.314114 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.314581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.370150 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.370682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.371127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.373210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lazy-loading 'fault' on Instance uuid 99bcefc4-8780-4660-ab70-6348d13dc688 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:54:33.452862 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d57012e9a04960b6c5dde2243dafbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87299c60c42b43e7bf7e8f92f30ae87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:33.464744 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-99b6ef34-e2b0-4516-859f-28c2951688f3 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 200 len: 1304 microversion: 2.1 time: 0.165319 Aug 29 23:54:33.465602 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 238/463] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:33 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:33.517340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e8849444-911d-4d66-a40a-db77f2873a42 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:33.518206 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e8849444-911d-4d66-a40a-db77f2873a42 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:33.526773 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8849444-911d-4d66-a40a-db77f2873a42 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.527281 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8849444-911d-4d66-a40a-db77f2873a42 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.527745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8849444-911d-4d66-a40a-db77f2873a42 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.528608 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8849444-911d-4d66-a40a-db77f2873a42 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.529051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8849444-911d-4d66-a40a-db77f2873a42 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.529476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8849444-911d-4d66-a40a-db77f2873a42 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.734360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:33.735167 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:33.743953 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.744791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.745244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.745988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:33.746457 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:33.747042 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:33.763110 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e8849444-911d-4d66-a40a-db77f2873a42 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:33.779412 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e8849444-911d-4d66-a40a-db77f2873a42 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.267242 Aug 29 23:54:33.781304 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 226/464] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:33 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:33.988888 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:34.009058 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:34.013049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:34.014294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6212d069-8a9f-480d-b767-547422e7cfd1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1723 microversion: 2.20 time: 0.288397 Aug 29 23:54:34.015075 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 239/465] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:33 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:34.045143 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0426242d-b9ec-4393-9450-661d27bd1fd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bbce5a7-c6c2-4b74-8412-d78e56338085"}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:34.047583 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0426242d-b9ec-4393-9450-661d27bd1fd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:34.054212 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0426242d-b9ec-4393-9450-661d27bd1fd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.055064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0426242d-b9ec-4393-9450-661d27bd1fd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.055505 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0426242d-b9ec-4393-9450-661d27bd1fd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.056216 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0426242d-b9ec-4393-9450-661d27bd1fd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.056664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0426242d-b9ec-4393-9450-661d27bd1fd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.057085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0426242d-b9ec-4393-9450-661d27bd1fd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.246827 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-f8004138-5f48-4e18-aa09-5f996e7cad8b req-7953a609-8775-4e28-9d53-8935fed012dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80567224-9d47-4087-b154-85564c2987cd", "name": "network-vif-plugged", "status": "completed", "tag": "4bfeae22-1324-4d1f-9b5f-0d481c03c512"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:34.259381 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-f8004138-5f48-4e18-aa09-5f996e7cad8b req-7953a609-8775-4e28-9d53-8935fed012dd service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.259731 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-f8004138-5f48-4e18-aa09-5f996e7cad8b req-7953a609-8775-4e28-9d53-8935fed012dd service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.260220 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-f8004138-5f48-4e18-aa09-5f996e7cad8b req-7953a609-8775-4e28-9d53-8935fed012dd service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.280112 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-f8004138-5f48-4e18-aa09-5f996e7cad8b req-7953a609-8775-4e28-9d53-8935fed012dd service nova] Creating event network-vif-plugged:4bfeae22-1324-4d1f-9b5f-0d481c03c512 for instance 80567224-9d47-4087-b154-85564c2987cd on hv-cinder-85427 Aug 29 23:54:34.283263 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-f8004138-5f48-4e18-aa09-5f996e7cad8b req-7953a609-8775-4e28-9d53-8935fed012dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041413 Aug 29 23:54:34.284142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 240/466] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:34.488907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:34.489775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] [instance: 99bcefc4-8780-4660-ab70-6348d13dc688] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:34.498332 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.501655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.501655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.501655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.501655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.502047 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.516440 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] HTTP exception thrown: Instance 99bcefc4-8780-4660-ab70-6348d13dc688 could not be found. Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Request method failure captured: Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 HTTP/1.1 Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVFgdcESXyYI38m0ugvyRGesz_4BPAVStpYYMbwc3zM2QFzEV6FHlzbFkZ2TZW0zLrNMrbd25sBc1Zvu_DijUhHLS_xhmKtwcRTBgEAa8wIQshPbcWhw-BGfmgZfTVLRNVUblPoiPcn8N0LSDejALQ0o5_aq6vat20l0cWGESUMQ-wQ Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 87299c60c42b43e7bf7e8f92f30ae87d Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-VolumesActionsTest-1258923295 Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:54:34.518116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/87299c60c42b43e7bf7e8f92f30ae87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/87299c60c42b43e7bf7e8f92f30ae87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/87299c60c42b43e7bf7e8f92f30ae87d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_87299c60c42b43e7bf7e8f92f30ae87d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-VolumesActionsTest-1258923295 Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 87299c60c42b43e7bf7e8f92f30ae87d Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-VolumesActionsTest-1258923295 Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-VolumesActionsTest-1258923295-project Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 74d57012e9a04960b6c5dde2243dafbc Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-VolumesActionsTest-1258923295-project Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 99bcefc4-8780-4660-ab70-6348d13dc688 could not be found. Aug 29 23:54:34.519804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '99bcefc4-8780-4660-ab70-6348d13dc688'} Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bcefc4-8780-4660-ab70-6348d13dc688 could not be found. Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:54:34.520704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bcefc4-8780-4660-ab70-6348d13dc688 could not be found. Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bcefc4-8780-4660-ab70-6348d13dc688 could not be found. Aug 29 23:54:34.522245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:54:34.523865 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] Returning 404 to user: Instance 99bcefc4-8780-4660-ab70-6348d13dc688 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:54:34.523865 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f71a5e66-878b-48c8-8ce9-bb850c740277 tempest-VolumesActionsTest-1258923295 tempest-VolumesActionsTest-1258923295-project] 10.222.0.58 "GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688" status: 404 len: 111 microversion: 2.1 time: 0.035851 Aug 29 23:54:34.523865 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 241/467] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:34 2022] GET /compute/v2.1/servers/99bcefc4-8780-4660-ab70-6348d13dc688 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:54:34.675764 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-397b2c56-915c-400e-bc8a-0b64565e3aa3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:34.686136 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-397b2c56-915c-400e-bc8a-0b64565e3aa3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:34.687023 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-397b2c56-915c-400e-bc8a-0b64565e3aa3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:34.687541 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-397b2c56-915c-400e-bc8a-0b64565e3aa3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:34.716920 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-397b2c56-915c-400e-bc8a-0b64565e3aa3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Going to try to stop instance {{(pid=127705) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 23:54:34.722697 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:34.998829 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-397b2c56-915c-400e-bc8a-0b64565e3aa3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/action" status: 202 len: 0 microversion: 2.1 time: 0.317058 Aug 29 23:54:34.998829 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 242/468] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:54:34 2022] POST /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:54:35.005924 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-882280b8-1164-47bd-a76d-d277719f98e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dd8f320-dd8f-4a2c-bbf6-bbd70147e16e"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:35.012135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-882280b8-1164-47bd-a76d-d277719f98e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:35.036158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-882280b8-1164-47bd-a76d-d277719f98e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.037404 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-882280b8-1164-47bd-a76d-d277719f98e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.038837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-882280b8-1164-47bd-a76d-d277719f98e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.040935 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-882280b8-1164-47bd-a76d-d277719f98e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.042329 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-882280b8-1164-47bd-a76d-d277719f98e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.043361 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-882280b8-1164-47bd-a76d-d277719f98e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.377185 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0426242d-b9ec-4393-9450-661d27bd1fd8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "POST /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.335529 Aug 29 23:54:35.378468 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 227/469] 10.222.0.58 () {62 vars in 1364 bytes} [Mon Aug 29 23:54:34 2022] POST /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments => generated 188 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:54:35.386056 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7974fc73-1bb5-4378-ba56-c8017bb60c11 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:35.387315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7974fc73-1bb5-4378-ba56-c8017bb60c11 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:35.400103 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7974fc73-1bb5-4378-ba56-c8017bb60c11 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.400904 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7974fc73-1bb5-4378-ba56-c8017bb60c11 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.401798 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7974fc73-1bb5-4378-ba56-c8017bb60c11 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.403048 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7974fc73-1bb5-4378-ba56-c8017bb60c11 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.403870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7974fc73-1bb5-4378-ba56-c8017bb60c11 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.404745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7974fc73-1bb5-4378-ba56-c8017bb60c11 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.588175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7974fc73-1bb5-4378-ba56-c8017bb60c11 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:35.597093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7974fc73-1bb5-4378-ba56-c8017bb60c11 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.216721 Aug 29 23:54:35.597771 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 228/470] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:35 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:35.603443 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-52bca6f7-1085-4905-beaa-d091705ea572 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:35.604325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-52bca6f7-1085-4905-beaa-d091705ea572 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:35.611026 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-52bca6f7-1085-4905-beaa-d091705ea572 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.611664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-52bca6f7-1085-4905-beaa-d091705ea572 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.612207 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-52bca6f7-1085-4905-beaa-d091705ea572 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.613030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-52bca6f7-1085-4905-beaa-d091705ea572 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.613599 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-52bca6f7-1085-4905-beaa-d091705ea572 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.614183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-52bca6f7-1085-4905-beaa-d091705ea572 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.808945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-52bca6f7-1085-4905-beaa-d091705ea572 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:35.823197 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-52bca6f7-1085-4905-beaa-d091705ea572 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.223568 Aug 29 23:54:35.824299 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 229/471] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:35 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:35.833909 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8bda46d5-ac8c-4bc2-a26f-497a91913c96 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:35.835170 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8bda46d5-ac8c-4bc2-a26f-497a91913c96 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:35.849961 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bda46d5-ac8c-4bc2-a26f-497a91913c96 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.854004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bda46d5-ac8c-4bc2-a26f-497a91913c96 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.854004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bda46d5-ac8c-4bc2-a26f-497a91913c96 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.854403 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bda46d5-ac8c-4bc2-a26f-497a91913c96 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:35.855351 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bda46d5-ac8c-4bc2-a26f-497a91913c96 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:35.856203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bda46d5-ac8c-4bc2-a26f-497a91913c96 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:35.923536 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8bda46d5-ac8c-4bc2-a26f-497a91913c96 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127706) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 23:54:36.318244 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8bda46d5-ac8c-4bc2-a26f-497a91913c96 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "POST /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/action" status: 202 len: 0 microversion: 2.20 time: 0.492007 Aug 29 23:54:36.326315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 230/472] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Aug 29 23:54:35 2022] POST /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:54:36.340548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:36.341388 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:36.357631 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.357631 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.357631 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.358389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.359072 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.359491 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.560372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:36.579654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:36.581588 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:36.583049 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-13a72c07-5e9d-4148-b23d-b659e5283fa8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1749 microversion: 2.20 time: 0.246845 Aug 29 23:54:36.583690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 231/473] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:36 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1749 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:36.603843 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-882280b8-1164-47bd-a76d-d277719f98e4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.608758 Aug 29 23:54:36.610163 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 243/474] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:54:34 2022] POST /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments => generated 194 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:36.645045 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-da0ae260-6a47-47a8-8293-c4743490fafa tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:36.645840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-da0ae260-6a47-47a8-8293-c4743490fafa tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:36.654466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da0ae260-6a47-47a8-8293-c4743490fafa tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.654466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da0ae260-6a47-47a8-8293-c4743490fafa tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.654803 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da0ae260-6a47-47a8-8293-c4743490fafa tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.655540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da0ae260-6a47-47a8-8293-c4743490fafa tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.656252 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da0ae260-6a47-47a8-8293-c4743490fafa tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.658918 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-da0ae260-6a47-47a8-8293-c4743490fafa tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.847583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c1e65bca-e5e3-4e3b-8263-71f13102ddf4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:36.848955 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c1e65bca-e5e3-4e3b-8263-71f13102ddf4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:36.856928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1e65bca-e5e3-4e3b-8263-71f13102ddf4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.857423 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1e65bca-e5e3-4e3b-8263-71f13102ddf4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.858074 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1e65bca-e5e3-4e3b-8263-71f13102ddf4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.858912 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1e65bca-e5e3-4e3b-8263-71f13102ddf4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:36.859343 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1e65bca-e5e3-4e3b-8263-71f13102ddf4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:36.859958 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c1e65bca-e5e3-4e3b-8263-71f13102ddf4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:36.867648 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-da0ae260-6a47-47a8-8293-c4743490fafa tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:36.876418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-da0ae260-6a47-47a8-8293-c4743490fafa tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1358 microversion: 2.1 time: 0.241558 Aug 29 23:54:36.888470 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 232/475] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:36 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:37.038865 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c1e65bca-e5e3-4e3b-8263-71f13102ddf4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:37.056038 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c1e65bca-e5e3-4e3b-8263-71f13102ddf4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.213313 Aug 29 23:54:37.057013 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 244/476] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:36 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:37.608098 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:37.608834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:37.620754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:37.620754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:37.620754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:37.620754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:37.621434 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:37.621434 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:37.807109 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:37.830514 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:37.830514 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:37.833227 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-056271d3-7ff3-484b-9684-d144a45553bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1749 microversion: 2.20 time: 0.228775 Aug 29 23:54:37.834136 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 233/477] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:37 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1749 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:37.905654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d89415fb-5618-48ae-855a-a4d4f357c7d1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:37.906775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d89415fb-5618-48ae-855a-a4d4f357c7d1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:37.919741 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d89415fb-5618-48ae-855a-a4d4f357c7d1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:37.920901 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d89415fb-5618-48ae-855a-a4d4f357c7d1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:37.921616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d89415fb-5618-48ae-855a-a4d4f357c7d1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:37.923062 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d89415fb-5618-48ae-855a-a4d4f357c7d1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:37.923846 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d89415fb-5618-48ae-855a-a4d4f357c7d1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:37.924583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d89415fb-5618-48ae-855a-a4d4f357c7d1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.080372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-eeed15ca-3cfc-400c-a8e0-1717b2d90681 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:38.081402 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-eeed15ca-3cfc-400c-a8e0-1717b2d90681 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:38.089721 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eeed15ca-3cfc-400c-a8e0-1717b2d90681 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.090157 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eeed15ca-3cfc-400c-a8e0-1717b2d90681 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.090661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eeed15ca-3cfc-400c-a8e0-1717b2d90681 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.091471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eeed15ca-3cfc-400c-a8e0-1717b2d90681 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.092003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eeed15ca-3cfc-400c-a8e0-1717b2d90681 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.092432 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eeed15ca-3cfc-400c-a8e0-1717b2d90681 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.096063 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:38.121022 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d89415fb-5618-48ae-855a-a4d4f357c7d1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:38.137855 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d89415fb-5618-48ae-855a-a4d4f357c7d1 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1548 microversion: 2.1 time: 0.241340 Aug 29 23:54:38.138740 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 245/478] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:37 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1548 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:38.175446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-85311a0d-cd32-45f5-8347-4cc536034b62 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:38.176482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-85311a0d-cd32-45f5-8347-4cc536034b62 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:38.187443 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-85311a0d-cd32-45f5-8347-4cc536034b62 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.187942 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-85311a0d-cd32-45f5-8347-4cc536034b62 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.188373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-85311a0d-cd32-45f5-8347-4cc536034b62 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.189296 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-85311a0d-cd32-45f5-8347-4cc536034b62 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.190173 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-85311a0d-cd32-45f5-8347-4cc536034b62 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.190611 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-85311a0d-cd32-45f5-8347-4cc536034b62 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.351175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-eeed15ca-3cfc-400c-a8e0-1717b2d90681 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:38.360751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-eeed15ca-3cfc-400c-a8e0-1717b2d90681 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.286058 Aug 29 23:54:38.361340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 234/479] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:38 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:38.398451 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-85311a0d-cd32-45f5-8347-4cc536034b62 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:38.406828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-85311a0d-cd32-45f5-8347-4cc536034b62 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1548 microversion: 2.1 time: 0.236383 Aug 29 23:54:38.407424 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 246/480] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:38 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:38.427483 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:38.433380 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:38.434166 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Searching by: {'deleted': False, 'project_id': '2f665e85ae5b4008b60765fd3076a331'} {{(pid=127706) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 23:54:38.441303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.441843 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.442342 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.443138 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.443685 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.444917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.546119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.multi_cell_list [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127706) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 23:54:38.738678 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-93f08171-5a07-4cd1-bb66-fd66db958943 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.315158 Aug 29 23:54:38.739706 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 235/481] 10.222.0.58 () {58 vars in 1125 bytes} [Mon Aug 29 23:54:38 2022] GET /compute/v2.1/servers => generated 342 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:38.751860 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-243d2343-bb13-42ee-a343-d24eee4f2b01 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:38.752514 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-243d2343-bb13-42ee-a343-d24eee4f2b01 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:38.760116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-243d2343-bb13-42ee-a343-d24eee4f2b01 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.760612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-243d2343-bb13-42ee-a343-d24eee4f2b01 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.761044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-243d2343-bb13-42ee-a343-d24eee4f2b01 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.761752 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-243d2343-bb13-42ee-a343-d24eee4f2b01 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.762204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-243d2343-bb13-42ee-a343-d24eee4f2b01 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.762677 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-243d2343-bb13-42ee-a343-d24eee4f2b01 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.874256 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:38.875344 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:38.886946 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.887823 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.888582 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.889854 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:38.890738 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:38.891495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:38.954453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-243d2343-bb13-42ee-a343-d24eee4f2b01 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:38.978444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-243d2343-bb13-42ee-a343-d24eee4f2b01 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1548 microversion: 2.1 time: 0.230262 Aug 29 23:54:38.979824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 247/482] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:38 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1548 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:39.149798 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:39.166941 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:39.169971 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:39.172299 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-83f03d1a-adda-4585-97cf-84545086a0fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1749 microversion: 2.20 time: 0.305895 Aug 29 23:54:39.173394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 236/483] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:38 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1749 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:39.386328 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-20e93520-1fe8-4973-b9a7-d439f2147a34 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:39.386982 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-20e93520-1fe8-4973-b9a7-d439f2147a34 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:39.393980 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20e93520-1fe8-4973-b9a7-d439f2147a34 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:39.394588 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20e93520-1fe8-4973-b9a7-d439f2147a34 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:39.395158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20e93520-1fe8-4973-b9a7-d439f2147a34 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:39.395946 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20e93520-1fe8-4973-b9a7-d439f2147a34 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:39.396527 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20e93520-1fe8-4973-b9a7-d439f2147a34 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:39.397094 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20e93520-1fe8-4973-b9a7-d439f2147a34 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:39.558290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-20e93520-1fe8-4973-b9a7-d439f2147a34 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:39.571568 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-20e93520-1fe8-4973-b9a7-d439f2147a34 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.189943 Aug 29 23:54:39.572341 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 248/484] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:39 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:40.198413 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:40.199059 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:40.208601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:40.208601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:40.208601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:40.208601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:40.209220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:40.209428 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:40.361023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:40.372022 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:40.373555 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:40.374763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ecbdc875-6c07-46ce-9ba5-554a4e1c1cce tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.181155 Aug 29 23:54:40.375336 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 237/485] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:40 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:40.606398 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b598a7ba-d41e-471a-999f-d16d0bb3a8d8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:40.607119 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b598a7ba-d41e-471a-999f-d16d0bb3a8d8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:40.614122 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b598a7ba-d41e-471a-999f-d16d0bb3a8d8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:40.614718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b598a7ba-d41e-471a-999f-d16d0bb3a8d8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:40.615207 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b598a7ba-d41e-471a-999f-d16d0bb3a8d8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:40.616523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b598a7ba-d41e-471a-999f-d16d0bb3a8d8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:40.617213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b598a7ba-d41e-471a-999f-d16d0bb3a8d8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:40.617737 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b598a7ba-d41e-471a-999f-d16d0bb3a8d8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:40.777604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b598a7ba-d41e-471a-999f-d16d0bb3a8d8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:40.786146 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b598a7ba-d41e-471a-999f-d16d0bb3a8d8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.183883 Aug 29 23:54:40.786977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 249/486] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:40 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:41.400441 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:41.401354 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:41.409373 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.409851 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.410280 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.411021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.411485 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.411898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.570406 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:41.582582 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:41.584026 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:41.585326 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e703770e-ca87-4266-98d8-10890464d079 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.189600 Aug 29 23:54:41.586120 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 238/487] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:41 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:41.810358 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-82186912-aac6-4952-8685-4ef890c00cb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:41.810942 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-82186912-aac6-4952-8685-4ef890c00cb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:41.818095 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82186912-aac6-4952-8685-4ef890c00cb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.818620 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82186912-aac6-4952-8685-4ef890c00cb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.819691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82186912-aac6-4952-8685-4ef890c00cb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.820739 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82186912-aac6-4952-8685-4ef890c00cb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:41.821265 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82186912-aac6-4952-8685-4ef890c00cb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:41.821796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-82186912-aac6-4952-8685-4ef890c00cb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:41.983039 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-82186912-aac6-4952-8685-4ef890c00cb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:41.991882 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-82186912-aac6-4952-8685-4ef890c00cb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.185555 Aug 29 23:54:41.992765 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 250/488] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:41 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:42.614336 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:42.615002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:42.622674 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:42.623164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:42.623602 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:42.624312 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:42.624766 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:42.625182 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:42.794718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:42.804602 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:42.806076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:42.807369 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f3ca1b4e-da5e-43c8-83af-4b17a74aa361 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.197273 Aug 29 23:54:42.808045 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 239/489] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:42 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:43.014188 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3fd8ac7f-9e7d-4b66-977b-3b403d63248c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:43.014849 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3fd8ac7f-9e7d-4b66-977b-3b403d63248c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:43.021787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fd8ac7f-9e7d-4b66-977b-3b403d63248c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.022828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fd8ac7f-9e7d-4b66-977b-3b403d63248c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.023270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fd8ac7f-9e7d-4b66-977b-3b403d63248c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.023996 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fd8ac7f-9e7d-4b66-977b-3b403d63248c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.024448 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fd8ac7f-9e7d-4b66-977b-3b403d63248c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.024870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fd8ac7f-9e7d-4b66-977b-3b403d63248c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.190488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3fd8ac7f-9e7d-4b66-977b-3b403d63248c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:43.202106 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3fd8ac7f-9e7d-4b66-977b-3b403d63248c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.191804 Aug 29 23:54:43.202755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 251/490] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:43 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:43.838674 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:43.840232 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:43.854169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.855425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.856211 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:43.857371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:43.858046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:43.858684 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.083635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:44.093785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:44.095504 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:44.096756 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0821a702-8bcd-4e5d-8c2b-e45d6fe9f6f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.267922 Aug 29 23:54:44.097317 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 240/491] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:43 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:44.231735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-233d2e29-cb59-49f4-abc6-1b646794df8c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:44.236987 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-233d2e29-cb59-49f4-abc6-1b646794df8c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:44.247569 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-233d2e29-cb59-49f4-abc6-1b646794df8c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.258530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-233d2e29-cb59-49f4-abc6-1b646794df8c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.258530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-233d2e29-cb59-49f4-abc6-1b646794df8c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.258530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-233d2e29-cb59-49f4-abc6-1b646794df8c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.258530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-233d2e29-cb59-49f4-abc6-1b646794df8c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.259542 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-233d2e29-cb59-49f4-abc6-1b646794df8c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.535713 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-233d2e29-cb59-49f4-abc6-1b646794df8c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:44.578129 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-233d2e29-cb59-49f4-abc6-1b646794df8c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.356873 Aug 29 23:54:44.588500 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 252/492] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:44 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:44.963825 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-75f92050-1b29-47e5-bf8e-f29c4546253b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "974b8208-99fd-40b5-a9ca-af647057f0ae"}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:44.968413 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-75f92050-1b29-47e5-bf8e-f29c4546253b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:44.982008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75f92050-1b29-47e5-bf8e-f29c4546253b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.982934 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75f92050-1b29-47e5-bf8e-f29c4546253b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.984596 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75f92050-1b29-47e5-bf8e-f29c4546253b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:44.986306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75f92050-1b29-47e5-bf8e-f29c4546253b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:44.987198 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75f92050-1b29-47e5-bf8e-f29c4546253b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:44.987749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75f92050-1b29-47e5-bf8e-f29c4546253b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.128676 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:45.130369 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:45.151219 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:45.159077 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:45.160055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.161097 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:45.161887 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:45.163339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.409973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:45.427059 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:45.432233 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:45.433640 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3634be7e-5272-46d9-a2ca-293a4c059701 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.310300 Aug 29 23:54:45.434481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 253/493] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:45 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:45.621105 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-761b6d8e-08dc-4abf-916a-3f5d7b9f5e9f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:45.629919 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-761b6d8e-08dc-4abf-916a-3f5d7b9f5e9f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:45.648089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-761b6d8e-08dc-4abf-916a-3f5d7b9f5e9f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:45.649758 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-761b6d8e-08dc-4abf-916a-3f5d7b9f5e9f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:45.650794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-761b6d8e-08dc-4abf-916a-3f5d7b9f5e9f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:45.651867 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-761b6d8e-08dc-4abf-916a-3f5d7b9f5e9f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:45.657250 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-761b6d8e-08dc-4abf-916a-3f5d7b9f5e9f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:45.657922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-761b6d8e-08dc-4abf-916a-3f5d7b9f5e9f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:46.063236 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-761b6d8e-08dc-4abf-916a-3f5d7b9f5e9f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:46.077700 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-761b6d8e-08dc-4abf-916a-3f5d7b9f5e9f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.463423 Aug 29 23:54:46.078915 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 254/494] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:45 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:46.190884 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-75f92050-1b29-47e5-bf8e-f29c4546253b tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "POST /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.235408 Aug 29 23:54:46.192233 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 241/495] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:54:44 2022] POST /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments => generated 194 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:54:46.466322 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:46.467904 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:46.476197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:46.477100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:46.477727 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:46.478879 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:46.479344 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:46.479775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:46.727497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:46.739596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:46.741890 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:46.743178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c4fb38c9-3c70-4492-9953-62c8cbdd02c8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.281011 Aug 29 23:54:46.743761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 255/496] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:46 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:47.118702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fe8e1896-b21f-4600-9e68-f2cfd4bfcb47 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:47.120981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-fe8e1896-b21f-4600-9e68-f2cfd4bfcb47 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:47.134714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe8e1896-b21f-4600-9e68-f2cfd4bfcb47 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:47.135603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe8e1896-b21f-4600-9e68-f2cfd4bfcb47 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:47.136722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe8e1896-b21f-4600-9e68-f2cfd4bfcb47 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:47.138298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe8e1896-b21f-4600-9e68-f2cfd4bfcb47 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:47.139465 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe8e1896-b21f-4600-9e68-f2cfd4bfcb47 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:47.140469 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe8e1896-b21f-4600-9e68-f2cfd4bfcb47 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:47.408987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-fe8e1896-b21f-4600-9e68-f2cfd4bfcb47 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:47.419768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-fe8e1896-b21f-4600-9e68-f2cfd4bfcb47 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.309131 Aug 29 23:54:47.423728 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 242/497] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:47 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:47.772457 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:47.774462 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:47.782604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:47.788002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:47.788002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:47.788002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:47.788002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:47.788636 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:48.070215 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:48.096481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:48.098674 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:48.105837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-03cb502f-1f46-46f0-903d-b4f47b125f3c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.336050 Aug 29 23:54:48.105837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 256/498] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:47 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:48.449869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9c19c818-9aaf-4365-a334-104fb31a3d10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:48.451549 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9c19c818-9aaf-4365-a334-104fb31a3d10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:48.473573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c19c818-9aaf-4365-a334-104fb31a3d10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:48.481524 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c19c818-9aaf-4365-a334-104fb31a3d10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:48.481524 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c19c818-9aaf-4365-a334-104fb31a3d10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:48.481524 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c19c818-9aaf-4365-a334-104fb31a3d10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:48.482944 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c19c818-9aaf-4365-a334-104fb31a3d10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:48.484408 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c19c818-9aaf-4365-a334-104fb31a3d10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:48.487426 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:48.736838 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9c19c818-9aaf-4365-a334-104fb31a3d10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:48.748132 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9c19c818-9aaf-4365-a334-104fb31a3d10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.303046 Aug 29 23:54:48.748755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 243/499] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:48 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:49.140453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:49.141815 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:49.149642 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:49.150267 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:49.150937 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:49.152529 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:49.153231 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:49.153815 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:49.160389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:49.392329 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:49.405844 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:49.414066 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:49.420261 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f080de86-fa62-4944-bdd1-863c26ecee46 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.284141 Aug 29 23:54:49.434457 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 257/500] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:49 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:49.774569 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-bb52641b-68b6-4870-adbe-261b9450781f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:49.775643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-bb52641b-68b6-4870-adbe-261b9450781f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:49.782963 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb52641b-68b6-4870-adbe-261b9450781f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:49.784104 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb52641b-68b6-4870-adbe-261b9450781f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:49.785010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb52641b-68b6-4870-adbe-261b9450781f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:49.786033 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb52641b-68b6-4870-adbe-261b9450781f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:49.786922 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb52641b-68b6-4870-adbe-261b9450781f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:49.787659 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bb52641b-68b6-4870-adbe-261b9450781f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:50.049324 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bb52641b-68b6-4870-adbe-261b9450781f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:50.060215 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-bb52641b-68b6-4870-adbe-261b9450781f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.292410 Aug 29 23:54:50.061145 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 244/501] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:49 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:50.454685 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:50.455498 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:50.464024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:50.464745 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:50.469011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:50.469011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:50.469011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:50.469011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:50.702825 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:50.723167 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:50.725168 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:50.727024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a67d47bc-6d42-42c9-851d-91ee35ccd389 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.280056 Aug 29 23:54:50.727720 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 258/502] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:50 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:54:51.092981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a4995368-21fe-45ac-8151-8ac21257056d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:51.092981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a4995368-21fe-45ac-8151-8ac21257056d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:51.104125 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a4995368-21fe-45ac-8151-8ac21257056d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.105217 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a4995368-21fe-45ac-8151-8ac21257056d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.106250 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a4995368-21fe-45ac-8151-8ac21257056d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.107600 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a4995368-21fe-45ac-8151-8ac21257056d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.108704 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a4995368-21fe-45ac-8151-8ac21257056d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.109575 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a4995368-21fe-45ac-8151-8ac21257056d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.292717 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a4995368-21fe-45ac-8151-8ac21257056d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:51.301882 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a4995368-21fe-45ac-8151-8ac21257056d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1678 microversion: 2.1 time: 0.221324 Aug 29 23:54:51.302472 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 245/503] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:51 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:51.772639 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:51.778844 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:51.795177 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.796376 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.798726 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:51.799818 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:51.800664 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:51.801519 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:52.255707 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:52.286793 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:52.290887 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:52.294697 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3536cebe-00a5-4f3f-ae36-3d2fafce81cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.541550 Aug 29 23:54:52.296402 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 259/504] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:51 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:52.331084 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-bc25a141-1f3e-48e5-bdd5-93cf4dcfd75f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:52.332039 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-bc25a141-1f3e-48e5-bdd5-93cf4dcfd75f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:52.348081 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc25a141-1f3e-48e5-bdd5-93cf4dcfd75f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.349102 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc25a141-1f3e-48e5-bdd5-93cf4dcfd75f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.349102 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc25a141-1f3e-48e5-bdd5-93cf4dcfd75f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:52.358326 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc25a141-1f3e-48e5-bdd5-93cf4dcfd75f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.358836 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc25a141-1f3e-48e5-bdd5-93cf4dcfd75f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.359281 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bc25a141-1f3e-48e5-bdd5-93cf4dcfd75f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:52.531784 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b3a02a09-1122-4b52-9e0d-dfc2ea960f45 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:52.537239 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b3a02a09-1122-4b52-9e0d-dfc2ea960f45 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:52.545274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b3a02a09-1122-4b52-9e0d-dfc2ea960f45 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.546166 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b3a02a09-1122-4b52-9e0d-dfc2ea960f45 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.546912 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b3a02a09-1122-4b52-9e0d-dfc2ea960f45 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:52.547837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b3a02a09-1122-4b52-9e0d-dfc2ea960f45 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.548725 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b3a02a09-1122-4b52-9e0d-dfc2ea960f45 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.549357 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b3a02a09-1122-4b52-9e0d-dfc2ea960f45 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:52.605421 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-b3a02a09-1122-4b52-9e0d-dfc2ea960f45 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lazy-loading 'flavor' on Instance uuid 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:54:52.855658 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bc25a141-1f3e-48e5-bdd5-93cf4dcfd75f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:52.891609 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-bc25a141-1f3e-48e5-bdd5-93cf4dcfd75f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1655 microversion: 2.1 time: 0.570093 Aug 29 23:54:52.898372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 246/505] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:52 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1655 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:52.945252 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-742d6714-c999-4233-a933-726da8489aca tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:54:52.957687 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-742d6714-c999-4233-a933-726da8489aca tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:52.962576 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-742d6714-c999-4233-a933-726da8489aca tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:52.962576 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-742d6714-c999-4233-a933-726da8489aca tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.025450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-742d6714-c999-4233-a933-726da8489aca tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Going to try to start instance {{(pid=127706) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 23:54:53.393811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-742d6714-c999-4233-a933-726da8489aca tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/action" status: 202 len: 0 microversion: 2.1 time: 0.457036 Aug 29 23:54:53.396541 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 247/506] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:54:52 2022] POST /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:54:53.402508 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b3a02a09-1122-4b52-9e0d-dfc2ea960f45 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/action" status: 200 len: 32 microversion: 2.1 time: 0.877123 Aug 29 23:54:53.404008 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 260/507] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:54:52 2022] POST /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/action => generated 32 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:54:53.420027 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0a1a2bd2-12ee-4574-8a18-5172bec18513 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:53.429871 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0a1a2bd2-12ee-4574-8a18-5172bec18513 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:53.430493 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:53.431559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:53.457299 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:53.458902 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0a1a2bd2-12ee-4574-8a18-5172bec18513 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:53.459778 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0a1a2bd2-12ee-4574-8a18-5172bec18513 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:53.460958 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0a1a2bd2-12ee-4574-8a18-5172bec18513 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.462200 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:53.464185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0a1a2bd2-12ee-4574-8a18-5172bec18513 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:53.465816 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.467239 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:53.468105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:53.469160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.476067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0a1a2bd2-12ee-4574-8a18-5172bec18513 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:53.476745 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0a1a2bd2-12ee-4574-8a18-5172bec18513 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:53.489383 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:54.046826 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:54.060177 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:54.073467 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:54.079472 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-695de1b2-4d89-4a95-8a46-a1a0405b0672 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1751 microversion: 2.20 time: 0.680670 Aug 29 23:54:54.080105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 248/508] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:53 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1751 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:54.089278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8515443d-ec0a-4591-b978-b8e45346dab5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:54.089921 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8515443d-ec0a-4591-b978-b8e45346dab5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:54.119142 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8515443d-ec0a-4591-b978-b8e45346dab5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.121074 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8515443d-ec0a-4591-b978-b8e45346dab5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.126391 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8515443d-ec0a-4591-b978-b8e45346dab5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:54.128075 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8515443d-ec0a-4591-b978-b8e45346dab5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:54.130684 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8515443d-ec0a-4591-b978-b8e45346dab5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:54.133547 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8515443d-ec0a-4591-b978-b8e45346dab5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:54.193377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0a1a2bd2-12ee-4574-8a18-5172bec18513 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:54.213914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0a1a2bd2-12ee-4574-8a18-5172bec18513 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1664 microversion: 2.1 time: 0.808051 Aug 29 23:54:54.225852 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 261/509] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:53 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1664 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:54.708461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8515443d-ec0a-4591-b978-b8e45346dab5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:54.734627 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8515443d-ec0a-4591-b978-b8e45346dab5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.650647 Aug 29 23:54:54.736721 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 249/510] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:54 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:55.109822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:55.111147 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:55.144026 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:55.151217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:55.157347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.163142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:55.164352 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:55.173923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.260684 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-95308162-9683-4793-a456-4618d2962c66 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:55.263747 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-95308162-9683-4793-a456-4618d2962c66 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:55.276598 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95308162-9683-4793-a456-4618d2962c66 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:55.277511 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95308162-9683-4793-a456-4618d2962c66 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:55.279445 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95308162-9683-4793-a456-4618d2962c66 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.281086 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95308162-9683-4793-a456-4618d2962c66 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:55.281874 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95308162-9683-4793-a456-4618d2962c66 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:55.283229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95308162-9683-4793-a456-4618d2962c66 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.943077 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:55.948432 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-95308162-9683-4793-a456-4618d2962c66 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:55.953633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:55.955384 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:55.956648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1f9a53d0-0863-4a2f-841a-a9752068ea74 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.851040 Aug 29 23:54:55.957800 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 262/511] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:55 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:55.963380 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-37d40c84-f433-4ccd-a5a2-0684fd7842b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:55.964263 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-37d40c84-f433-4ccd-a5a2-0684fd7842b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:55.966245 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-95308162-9683-4793-a456-4618d2962c66 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1664 microversion: 2.1 time: 0.719406 Aug 29 23:54:55.972017 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37d40c84-f433-4ccd-a5a2-0684fd7842b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:55.972791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37d40c84-f433-4ccd-a5a2-0684fd7842b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:55.973390 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37d40c84-f433-4ccd-a5a2-0684fd7842b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.975062 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37d40c84-f433-4ccd-a5a2-0684fd7842b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:55.975830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37d40c84-f433-4ccd-a5a2-0684fd7842b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:55.976419 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37d40c84-f433-4ccd-a5a2-0684fd7842b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:55.989583 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 250/512] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:55 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1664 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:56.159996 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-37d40c84-f433-4ccd-a5a2-0684fd7842b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:56.171233 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-37d40c84-f433-4ccd-a5a2-0684fd7842b2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.212078 Aug 29 23:54:56.171827 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 263/513] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:55 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:56.996154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:56.996154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:57.005905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7be9b648-80cf-4861-a33e-cb1e5595e025 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:57.007573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7be9b648-80cf-4861-a33e-cb1e5595e025 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:57.007918 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.009076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.010161 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.012761 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.014118 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.015144 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.021145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7be9b648-80cf-4861-a33e-cb1e5595e025 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.023244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7be9b648-80cf-4861-a33e-cb1e5595e025 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.024254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7be9b648-80cf-4861-a33e-cb1e5595e025 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.025808 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7be9b648-80cf-4861-a33e-cb1e5595e025 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.027281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7be9b648-80cf-4861-a33e-cb1e5595e025 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.028514 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7be9b648-80cf-4861-a33e-cb1e5595e025 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.460391 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:57.484765 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7be9b648-80cf-4861-a33e-cb1e5595e025 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:57.488230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:57.489876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:57.491208 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-90f4bba5-ae2a-4067-b08e-8754f318ac28 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.509198 Aug 29 23:54:57.504880 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 251/514] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:56 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:57.509717 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7be9b648-80cf-4861-a33e-cb1e5595e025 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1668 microversion: 2.1 time: 0.513805 Aug 29 23:54:57.511427 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 264/515] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:56 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1668 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:54:57.515524 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7c5d60b1-58c3-47f4-9405-dece05d7afee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:57.516509 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7c5d60b1-58c3-47f4-9405-dece05d7afee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:57.544801 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c5d60b1-58c3-47f4-9405-dece05d7afee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.545638 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c5d60b1-58c3-47f4-9405-dece05d7afee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.547649 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c5d60b1-58c3-47f4-9405-dece05d7afee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.549158 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c5d60b1-58c3-47f4-9405-dece05d7afee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:57.550555 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c5d60b1-58c3-47f4-9405-dece05d7afee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:57.551341 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c5d60b1-58c3-47f4-9405-dece05d7afee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:57.828288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7c5d60b1-58c3-47f4-9405-dece05d7afee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:57.838978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7c5d60b1-58c3-47f4-9405-dece05d7afee tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.331980 Aug 29 23:54:57.840282 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 252/516] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:57 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:54:58.527843 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:58.533973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:58.541603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:58.542538 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:58.543737 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:58.545476 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:58.546631 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:58.547628 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:58.888104 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0d58ffb9-898f-40cf-b02d-ab56f277e41f tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:54:58.890544 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0d58ffb9-898f-40cf-b02d-ab56f277e41f tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:54:58.946907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d58ffb9-898f-40cf-b02d-ab56f277e41f tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:58.957618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d58ffb9-898f-40cf-b02d-ab56f277e41f tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:58.957618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d58ffb9-898f-40cf-b02d-ab56f277e41f tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:58.957618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d58ffb9-898f-40cf-b02d-ab56f277e41f tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:54:58.970015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d58ffb9-898f-40cf-b02d-ab56f277e41f tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:54:58.980298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d58ffb9-898f-40cf-b02d-ab56f277e41f tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:54:58.982802 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:59.007179 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:59.010867 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:59.014068 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-78b8b776-e984-486c-b8a7-16c0e99096b4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.495201 Aug 29 23:54:59.026366 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 265/517] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:54:58 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:54:59.439083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0d58ffb9-898f-40cf-b02d-ab56f277e41f tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:54:59.454650 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0d58ffb9-898f-40cf-b02d-ab56f277e41f tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.578385 Aug 29 23:54:59.456494 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 253/518] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:54:58 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:00.067808 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:00.070376 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:00.087961 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:00.089448 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:00.090247 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.091950 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:00.093534 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:00.094327 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.409309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.420702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.422310 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.423619 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b1a0ce3c-21f6-4cc1-b9ab-daf021c79d61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.368409 Aug 29 23:55:00.424189 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 266/519] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:00 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:00.479449 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7443e93a-fdb8-4994-aa6d-b2caefee6166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:00.480225 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7443e93a-fdb8-4994-aa6d-b2caefee6166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:00.488211 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7443e93a-fdb8-4994-aa6d-b2caefee6166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:00.488704 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7443e93a-fdb8-4994-aa6d-b2caefee6166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:00.489333 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7443e93a-fdb8-4994-aa6d-b2caefee6166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.490284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7443e93a-fdb8-4994-aa6d-b2caefee6166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:00.490763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7443e93a-fdb8-4994-aa6d-b2caefee6166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:00.491369 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7443e93a-fdb8-4994-aa6d-b2caefee6166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:00.684374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7443e93a-fdb8-4994-aa6d-b2caefee6166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:00.696063 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7443e93a-fdb8-4994-aa6d-b2caefee6166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.220717 Aug 29 23:55:00.696941 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 254/520] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:00 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:01.449709 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:01.451855 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:01.467359 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=70 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:01.477218 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.477770 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.478228 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.479290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.479859 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.480356 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.750259 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-95cfb5db-82c4-415f-ad5f-09b1bd4a8802 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:01.772954 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-95cfb5db-82c4-415f-ad5f-09b1bd4a8802 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:01.819641 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95cfb5db-82c4-415f-ad5f-09b1bd4a8802 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.820964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95cfb5db-82c4-415f-ad5f-09b1bd4a8802 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.822001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95cfb5db-82c4-415f-ad5f-09b1bd4a8802 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.824003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95cfb5db-82c4-415f-ad5f-09b1bd4a8802 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:01.825053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95cfb5db-82c4-415f-ad5f-09b1bd4a8802 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:01.826449 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95cfb5db-82c4-415f-ad5f-09b1bd4a8802 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:01.895061 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:01.908388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:01.910689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:01.915577 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0dbb3959-a8ed-48ce-b224-80e766b099b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.468494 Aug 29 23:55:01.919105 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 267/521] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:01 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:02.225285 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-95cfb5db-82c4-415f-ad5f-09b1bd4a8802 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:02.239632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-95cfb5db-82c4-415f-ad5f-09b1bd4a8802 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.501884 Aug 29 23:55:02.242877 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 255/522] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:01 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:02.978737 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:02.981296 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:02.992467 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.000563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.000563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:03.000563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.000563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.001070 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:03.271645 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ee442402-52be-42b0-bed7-7ab9d7e25684 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:03.276188 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ee442402-52be-42b0-bed7-7ab9d7e25684 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:03.280173 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:03.326076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ee442402-52be-42b0-bed7-7ab9d7e25684 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.326076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ee442402-52be-42b0-bed7-7ab9d7e25684 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.326076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ee442402-52be-42b0-bed7-7ab9d7e25684 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:03.326076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ee442402-52be-42b0-bed7-7ab9d7e25684 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:03.327474 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ee442402-52be-42b0-bed7-7ab9d7e25684 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:03.327474 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ee442402-52be-42b0-bed7-7ab9d7e25684 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:03.870847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:03.870847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:03.916011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:03.916011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b19f4315-8ba4-4a6d-9630-ef4b368a2d05 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.851261 Aug 29 23:55:03.916011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 268/523] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:02 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:03.918776 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ee442402-52be-42b0-bed7-7ab9d7e25684 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:03.923935 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ee442402-52be-42b0-bed7-7ab9d7e25684 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.662497 Aug 29 23:55:03.931779 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 256/524] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:03 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:04.853946 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:04.858128 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:04.884835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:04.885340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:04.886001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:04.886959 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:04.887699 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:04.888331 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:04.957366 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f0c792d2-3405-4409-b8c2-f3ef8cf06375 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:04.957366 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f0c792d2-3405-4409-b8c2-f3ef8cf06375 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:04.964757 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0c792d2-3405-4409-b8c2-f3ef8cf06375 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:04.972730 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0c792d2-3405-4409-b8c2-f3ef8cf06375 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:04.977749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0c792d2-3405-4409-b8c2-f3ef8cf06375 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:04.984248 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0c792d2-3405-4409-b8c2-f3ef8cf06375 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:04.984971 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0c792d2-3405-4409-b8c2-f3ef8cf06375 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:04.987117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0c792d2-3405-4409-b8c2-f3ef8cf06375 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:05.377968 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:05.404781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:05.434983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:05.438917 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b248c6d0-242c-476b-b2f7-7ad315df3cd0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.592473 Aug 29 23:55:05.446668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 269/525] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:04 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:05.472192 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f0c792d2-3405-4409-b8c2-f3ef8cf06375 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:05.482366 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f0c792d2-3405-4409-b8c2-f3ef8cf06375 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.535963 Aug 29 23:55:05.487081 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 257/526] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:04 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:06.325008 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f0f34e7b-0a87-4594-a928-aaba2287fa8f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:06.325824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f0f34e7b-0a87-4594-a928-aaba2287fa8f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:06.334535 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f0f34e7b-0a87-4594-a928-aaba2287fa8f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.338951 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f0f34e7b-0a87-4594-a928-aaba2287fa8f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.338951 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f0f34e7b-0a87-4594-a928-aaba2287fa8f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.338951 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f0f34e7b-0a87-4594-a928-aaba2287fa8f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.338951 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f0f34e7b-0a87-4594-a928-aaba2287fa8f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.339777 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f0f34e7b-0a87-4594-a928-aaba2287fa8f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.484143 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:06.484744 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:06.508880 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.514545 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.515338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.516257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.521661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.525458 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.562317 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f0f34e7b-0a87-4594-a928-aaba2287fa8f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:06.578596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f0f34e7b-0a87-4594-a928-aaba2287fa8f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1594 microversion: 2.1 time: 0.256862 Aug 29 23:55:06.581286 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 270/527] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:06 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1594 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:06.595736 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7f5875bb-f464-4829-ac24-bbc9c6ef788c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:06.596755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7f5875bb-f464-4829-ac24-bbc9c6ef788c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:06.613536 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f5875bb-f464-4829-ac24-bbc9c6ef788c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.614229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f5875bb-f464-4829-ac24-bbc9c6ef788c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.614902 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f5875bb-f464-4829-ac24-bbc9c6ef788c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.616178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f5875bb-f464-4829-ac24-bbc9c6ef788c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:06.617456 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f5875bb-f464-4829-ac24-bbc9c6ef788c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:06.618227 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7f5875bb-f464-4829-ac24-bbc9c6ef788c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:06.879166 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7f5875bb-f464-4829-ac24-bbc9c6ef788c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:06.890281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:06.894840 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7f5875bb-f464-4829-ac24-bbc9c6ef788c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.310621 Aug 29 23:55:06.899990 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 271/528] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:06 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:06.951151 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:06.977224 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:06.981515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:06.984094 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d0572a52-0492-4135-a74f-ff06c0167a59 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.515319 Aug 29 23:55:06.995892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 258/529] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:06 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:07.068498 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e067ef00-1276-441f-81b6-5003d1ad1ef2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:07.077949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e067ef00-1276-441f-81b6-5003d1ad1ef2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:07.089285 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e067ef00-1276-441f-81b6-5003d1ad1ef2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.090527 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e067ef00-1276-441f-81b6-5003d1ad1ef2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.091568 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e067ef00-1276-441f-81b6-5003d1ad1ef2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.093077 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e067ef00-1276-441f-81b6-5003d1ad1ef2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.094332 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e067ef00-1276-441f-81b6-5003d1ad1ef2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.095413 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e067ef00-1276-441f-81b6-5003d1ad1ef2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.152312 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e067ef00-1276-441f-81b6-5003d1ad1ef2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b/ips" status: 200 len: 150 microversion: 2.1 time: 0.099525 Aug 29 23:55:07.184676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9935689c-45c6-4768-948f-69b24cd6cc87"}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:07.188572 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:07.192658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 272/530] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Aug 29 23:55:07 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b/ips => generated 150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:07.203088 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.212534 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.213555 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.214705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.215468 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.216064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.385086 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Invalid volume: volume 9935689c-45c6-4768-948f-69b24cd6cc87 is already attached to instances: 32036006-145d-499d-848e-16bd2f8f9abf Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: POST /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b/os-volume_attachments HTTP/1.1 Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 74 Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:55:07.390785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {"volumeAttachment": {"volumeId": "9935689c-45c6-4768-948f-69b24cd6cc87"}} Aug 29 23:55:07.397029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Invalid volume: volume 9935689c-45c6-4768-948f-69b24cd6cc87 is already attached to instances: 32036006-145d-499d-848e-16bd2f8f9abf Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'server_id': 'b57d3d9f-7fe5-45b7-8e55-2652336c453b', 'body': {'volumeAttachment': {'volumeId': '9935689c-45c6-4768-948f-69b24cd6cc87'}}} Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9935689c-45c6-4768-948f-69b24cd6cc87 is already attached to instances: 32036006-145d-499d-848e-16bd2f8f9abf Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:55:07.398901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9935689c-45c6-4768-948f-69b24cd6cc87 is already attached to instances: 32036006-145d-499d-848e-16bd2f8f9abf Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:07.401269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:07.405241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:07.405241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:55:07.405241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:55:07.405241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9935689c-45c6-4768-948f-69b24cd6cc87 is already attached to instances: 32036006-145d-499d-848e-16bd2f8f9abf Aug 29 23:55:07.405241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:55:07.405241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 400 to user: Invalid volume: volume 9935689c-45c6-4768-948f-69b24cd6cc87 is already attached to instances: 32036006-145d-499d-848e-16bd2f8f9abf {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:55:07.405241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-cfc8bcb2-4138-4fe4-a8a0-945be176d930 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.223045 Aug 29 23:55:07.406466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-53e632b2-d08c-46ab-9186-6b42051422c7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:07.407407 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-53e632b2-d08c-46ab-9186-6b42051422c7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:07.413105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 259/531] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:55:07 2022] POST /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b/os-volume_attachments => generated 174 bytes in 244 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:55:07.416925 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53e632b2-d08c-46ab-9186-6b42051422c7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.419751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53e632b2-d08c-46ab-9186-6b42051422c7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.419751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53e632b2-d08c-46ab-9186-6b42051422c7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.419751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53e632b2-d08c-46ab-9186-6b42051422c7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.419751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53e632b2-d08c-46ab-9186-6b42051422c7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.420115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53e632b2-d08c-46ab-9186-6b42051422c7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.465070 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-53e632b2-d08c-46ab-9186-6b42051422c7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:55:07.860944 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-53e632b2-d08c-46ab-9186-6b42051422c7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 204 len: 0 microversion: 2.1 time: 0.458256 Aug 29 23:55:07.861566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 273/532] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:55:07 2022] DELETE /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:55:07.871497 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3288f1cb-24cf-4a77-9777-1513df4a0cf2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:07.872113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3288f1cb-24cf-4a77-9777-1513df4a0cf2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:07.897953 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3288f1cb-24cf-4a77-9777-1513df4a0cf2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.898650 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3288f1cb-24cf-4a77-9777-1513df4a0cf2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.900042 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3288f1cb-24cf-4a77-9777-1513df4a0cf2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.901861 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3288f1cb-24cf-4a77-9777-1513df4a0cf2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.902362 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3288f1cb-24cf-4a77-9777-1513df4a0cf2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.902837 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3288f1cb-24cf-4a77-9777-1513df4a0cf2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.939572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9eb6315c-0366-4a2e-8f31-164b14f95bcf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:07.940340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9eb6315c-0366-4a2e-8f31-164b14f95bcf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:07.953116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9eb6315c-0366-4a2e-8f31-164b14f95bcf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.954046 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9eb6315c-0366-4a2e-8f31-164b14f95bcf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.954624 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9eb6315c-0366-4a2e-8f31-164b14f95bcf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:07.955771 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9eb6315c-0366-4a2e-8f31-164b14f95bcf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:07.956587 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9eb6315c-0366-4a2e-8f31-164b14f95bcf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:07.957285 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9eb6315c-0366-4a2e-8f31-164b14f95bcf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:08.176201 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3288f1cb-24cf-4a77-9777-1513df4a0cf2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:08.187022 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3288f1cb-24cf-4a77-9777-1513df4a0cf2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1682 microversion: 2.1 time: 0.319449 Aug 29 23:55:08.188493 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 260/533] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:07 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1682 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:08.206918 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:08.207549 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:08.221841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:08.222819 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:08.223622 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:08.226304 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:08.227345 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:08.228226 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:08.636439 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9eb6315c-0366-4a2e-8f31-164b14f95bcf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:08.673102 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9eb6315c-0366-4a2e-8f31-164b14f95bcf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.734519 Aug 29 23:55:08.680785 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 274/534] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:07 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:08.744903 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:08.769688 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:08.772596 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:08.777663 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a384e96c-9e70-434d-a6af-a3d4480fe935 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.587942 Aug 29 23:55:08.781125 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 261/535] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:08 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:09.214331 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-beba134a-c642-486b-b239-698c3da05824 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:09.215011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-beba134a-c642-486b-b239-698c3da05824 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:09.221835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-beba134a-c642-486b-b239-698c3da05824 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:09.222322 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-beba134a-c642-486b-b239-698c3da05824 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:09.222790 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-beba134a-c642-486b-b239-698c3da05824 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:09.223505 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-beba134a-c642-486b-b239-698c3da05824 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:09.225786 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-beba134a-c642-486b-b239-698c3da05824 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:09.226445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-beba134a-c642-486b-b239-698c3da05824 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:09.652130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-beba134a-c642-486b-b239-698c3da05824 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:09.660294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-beba134a-c642-486b-b239-698c3da05824 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1682 microversion: 2.1 time: 0.450187 Aug 29 23:55:09.660880 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 275/536] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:09 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1682 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:09.726338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b9c9df1d-5296-43ed-b7d3-d6495c7bf9ad tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:09.727015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b9c9df1d-5296-43ed-b7d3-d6495c7bf9ad tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:09.733779 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9c9df1d-5296-43ed-b7d3-d6495c7bf9ad tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:09.734270 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9c9df1d-5296-43ed-b7d3-d6495c7bf9ad tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:09.735227 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9c9df1d-5296-43ed-b7d3-d6495c7bf9ad tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:09.735449 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9c9df1d-5296-43ed-b7d3-d6495c7bf9ad tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:09.735901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9c9df1d-5296-43ed-b7d3-d6495c7bf9ad tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:09.736891 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b9c9df1d-5296-43ed-b7d3-d6495c7bf9ad tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:09.808203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:09.808977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:09.817326 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:09.817943 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:09.818570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:09.819615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:09.820205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:09.820643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:10.032685 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b9c9df1d-5296-43ed-b7d3-d6495c7bf9ad tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:10.048146 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b9c9df1d-5296-43ed-b7d3-d6495c7bf9ad tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.326045 Aug 29 23:55:10.062598 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 262/537] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:09 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:10.116190 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:10.131741 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:10.133377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:10.134683 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0c02f4f1-2755-4fb3-b027-21e70784d870 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.330446 Aug 29 23:55:10.135250 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 276/538] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:09 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:10.683603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e9273f24-b8f6-4c65-ab51-11141b197a3f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:10.687934 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e9273f24-b8f6-4c65-ab51-11141b197a3f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:10.698600 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e9273f24-b8f6-4c65-ab51-11141b197a3f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:10.699082 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e9273f24-b8f6-4c65-ab51-11141b197a3f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:10.699502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e9273f24-b8f6-4c65-ab51-11141b197a3f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:10.701378 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e9273f24-b8f6-4c65-ab51-11141b197a3f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:10.701378 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e9273f24-b8f6-4c65-ab51-11141b197a3f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:10.701378 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e9273f24-b8f6-4c65-ab51-11141b197a3f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:10.996969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e9273f24-b8f6-4c65-ab51-11141b197a3f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.013688 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e9273f24-b8f6-4c65-ab51-11141b197a3f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1682 microversion: 2.1 time: 0.334742 Aug 29 23:55:11.015244 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 263/539] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:10 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:11.073000 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-79cb8292-8abc-4671-a7b5-1b27a5e98981 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:11.073635 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-79cb8292-8abc-4671-a7b5-1b27a5e98981 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:11.082055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79cb8292-8abc-4671-a7b5-1b27a5e98981 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.082588 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79cb8292-8abc-4671-a7b5-1b27a5e98981 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.083158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79cb8292-8abc-4671-a7b5-1b27a5e98981 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.094572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79cb8292-8abc-4671-a7b5-1b27a5e98981 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.094572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79cb8292-8abc-4671-a7b5-1b27a5e98981 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.094572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-79cb8292-8abc-4671-a7b5-1b27a5e98981 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.208828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:11.208828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:11.208828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.208828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.209415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.209415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.209415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.209415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.411880 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-79cb8292-8abc-4671-a7b5-1b27a5e98981 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.421745 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-79cb8292-8abc-4671-a7b5-1b27a5e98981 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.354501 Aug 29 23:55:11.439067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 277/540] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:11 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:11.572496 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-1bfa22f1-b05e-44bc-bc57-3e711e3655c2 req-1f43642e-d32e-4578-bb6f-2b7ad107f2ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80567224-9d47-4087-b154-85564c2987cd", "tag": "4bfeae22-1324-4d1f-9b5f-0d481c03c512"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:11.628529 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-1bfa22f1-b05e-44bc-bc57-3e711e3655c2 req-1f43642e-d32e-4578-bb6f-2b7ad107f2ab service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:11.629811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-1bfa22f1-b05e-44bc-bc57-3e711e3655c2 req-1f43642e-d32e-4578-bb6f-2b7ad107f2ab service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:11.631550 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-1bfa22f1-b05e-44bc-bc57-3e711e3655c2 req-1f43642e-d32e-4578-bb6f-2b7ad107f2ab service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:11.652644 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.662491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-1bfa22f1-b05e-44bc-bc57-3e711e3655c2 req-1f43642e-d32e-4578-bb6f-2b7ad107f2ab service nova] Creating event network-changed:4bfeae22-1324-4d1f-9b5f-0d481c03c512 for instance 80567224-9d47-4087-b154-85564c2987cd on hv-cinder-85427 Aug 29 23:55:11.670221 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:11.675105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.677294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:11.678931 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-01debc4c-3f0f-455c-a7ab-bb2d359b2fed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.523100 Aug 29 23:55:11.698708 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 264/541] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:11 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:11.699411 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-1bfa22f1-b05e-44bc-bc57-3e711e3655c2 req-1f43642e-d32e-4578-bb6f-2b7ad107f2ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117817 Aug 29 23:55:11.699411 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 278/542] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:12.044949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-039278a6-d363-47ff-a0f2-620a8bc38a0a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:12.046347 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-039278a6-d363-47ff-a0f2-620a8bc38a0a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:12.057217 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-039278a6-d363-47ff-a0f2-620a8bc38a0a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.060763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-039278a6-d363-47ff-a0f2-620a8bc38a0a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.060763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-039278a6-d363-47ff-a0f2-620a8bc38a0a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.060763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-039278a6-d363-47ff-a0f2-620a8bc38a0a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.060763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-039278a6-d363-47ff-a0f2-620a8bc38a0a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.061759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-039278a6-d363-47ff-a0f2-620a8bc38a0a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.300854 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-039278a6-d363-47ff-a0f2-620a8bc38a0a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:12.329190 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-039278a6-d363-47ff-a0f2-620a8bc38a0a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1682 microversion: 2.1 time: 0.290997 Aug 29 23:55:12.329803 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 265/543] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:12 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:12.465081 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-99818c71-71f1-4f9d-8cc2-fd34be62f52c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:12.469281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-99818c71-71f1-4f9d-8cc2-fd34be62f52c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:12.528895 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99818c71-71f1-4f9d-8cc2-fd34be62f52c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.532121 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99818c71-71f1-4f9d-8cc2-fd34be62f52c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.532121 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99818c71-71f1-4f9d-8cc2-fd34be62f52c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.535389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99818c71-71f1-4f9d-8cc2-fd34be62f52c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.537895 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99818c71-71f1-4f9d-8cc2-fd34be62f52c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.539228 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99818c71-71f1-4f9d-8cc2-fd34be62f52c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.716643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:12.717446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:12.731183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.734981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.736217 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:12.741462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:12.743862 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:12.746410 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:13.276271 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-99818c71-71f1-4f9d-8cc2-fd34be62f52c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:13.291235 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-99818c71-71f1-4f9d-8cc2-fd34be62f52c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.846842 Aug 29 23:55:13.292160 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 279/544] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:12 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:13.349713 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:13.354224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2c27d45d-7cd5-4913-bc29-639d8a22e9a6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:13.355104 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2c27d45d-7cd5-4913-bc29-639d8a22e9a6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:13.362120 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:13.362631 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c27d45d-7cd5-4913-bc29-639d8a22e9a6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:13.363288 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c27d45d-7cd5-4913-bc29-639d8a22e9a6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:13.364020 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c27d45d-7cd5-4913-bc29-639d8a22e9a6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:13.364847 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:13.365872 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c27d45d-7cd5-4913-bc29-639d8a22e9a6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:13.366527 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c27d45d-7cd5-4913-bc29-639d8a22e9a6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:13.367118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c27d45d-7cd5-4913-bc29-639d8a22e9a6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:13.367929 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ddd0cbdd-700e-4d62-aa0b-7f5629bb8bb6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.656587 Aug 29 23:55:13.369075 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 266/545] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:12 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:13.794867 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2c27d45d-7cd5-4913-bc29-639d8a22e9a6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:13.806599 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2c27d45d-7cd5-4913-bc29-639d8a22e9a6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1682 microversion: 2.1 time: 0.457876 Aug 29 23:55:13.817009 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 280/546] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:13 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1682 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:14.322297 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b52d8892-229f-462e-96ac-79a68f2bf791 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:14.322297 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b52d8892-229f-462e-96ac-79a68f2bf791 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:14.332066 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52d8892-229f-462e-96ac-79a68f2bf791 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.333456 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52d8892-229f-462e-96ac-79a68f2bf791 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.334403 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52d8892-229f-462e-96ac-79a68f2bf791 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.335540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52d8892-229f-462e-96ac-79a68f2bf791 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.336346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52d8892-229f-462e-96ac-79a68f2bf791 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.336968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52d8892-229f-462e-96ac-79a68f2bf791 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.400383 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:14.401237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:14.428100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.433377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.437004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.437004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.437004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.437004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.837318 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b52d8892-229f-462e-96ac-79a68f2bf791 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:14.845264 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:14.846663 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b52d8892-229f-462e-96ac-79a68f2bf791 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.536552 Aug 29 23:55:14.856375 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:14.858396 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:14.860042 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0c99ac04-3b83-4db4-8ac0-d6f289a20f7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.470797 Aug 29 23:55:14.862685 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 281/548] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:14 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:14.875507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 267/548] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:14 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:14.885385 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8685b60b-9223-43e1-ae41-185b71651e3b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:14.886053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8685b60b-9223-43e1-ae41-185b71651e3b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:14.897016 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8685b60b-9223-43e1-ae41-185b71651e3b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.897806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8685b60b-9223-43e1-ae41-185b71651e3b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.898375 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8685b60b-9223-43e1-ae41-185b71651e3b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:14.899290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8685b60b-9223-43e1-ae41-185b71651e3b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:14.900137 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8685b60b-9223-43e1-ae41-185b71651e3b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:14.900628 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8685b60b-9223-43e1-ae41-185b71651e3b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.059003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-d85fb0d7-5635-47d6-bc10-313853bed8ee req-79814324-044b-4e45-832a-9bec9ce48fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57d3d9f-7fe5-45b7-8e55-2652336c453b", "name": "network-vif-deleted", "tag": "acc77992-4cc6-4366-b576-3d7fb81a0859"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:15.092303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-d85fb0d7-5635-47d6-bc10-313853bed8ee req-79814324-044b-4e45-832a-9bec9ce48fbe service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.092499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8685b60b-9223-43e1-ae41-185b71651e3b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:15.093816 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-d85fb0d7-5635-47d6-bc10-313853bed8ee req-79814324-044b-4e45-832a-9bec9ce48fbe service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.098286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-d85fb0d7-5635-47d6-bc10-313853bed8ee req-79814324-044b-4e45-832a-9bec9ce48fbe service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.108908 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8685b60b-9223-43e1-ae41-185b71651e3b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1615 microversion: 2.1 time: 0.245068 Aug 29 23:55:15.113194 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 282/549] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:14 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1615 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:15.131648 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-d85fb0d7-5635-47d6-bc10-313853bed8ee req-79814324-044b-4e45-832a-9bec9ce48fbe service nova] Creating event network-vif-deleted:acc77992-4cc6-4366-b576-3d7fb81a0859 for instance b57d3d9f-7fe5-45b7-8e55-2652336c453b on hv-cinder-85427 Aug 29 23:55:15.155973 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-d85fb0d7-5635-47d6-bc10-313853bed8ee req-79814324-044b-4e45-832a-9bec9ce48fbe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098856 Aug 29 23:55:15.162483 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 268/550] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:15.869317 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b7e3777a-c757-45ec-8d31-c32d8d0963cd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:15.875184 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b7e3777a-c757-45ec-8d31-c32d8d0963cd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:15.885188 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7e3777a-c757-45ec-8d31-c32d8d0963cd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.888963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7e3777a-c757-45ec-8d31-c32d8d0963cd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.889666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7e3777a-c757-45ec-8d31-c32d8d0963cd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.890659 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7e3777a-c757-45ec-8d31-c32d8d0963cd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.891281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7e3777a-c757-45ec-8d31-c32d8d0963cd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.891892 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7e3777a-c757-45ec-8d31-c32d8d0963cd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.923127 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:15.929063 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:15.973689 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.976693 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:15.981327 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:15.988994 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:15.999454 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:16.000227 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:16.782479 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:16.807447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:16.823964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:16.832660 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6b690778-d7bd-4302-88ab-67250024580c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.936020 Aug 29 23:55:16.833499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b7e3777a-c757-45ec-8d31-c32d8d0963cd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:16.846367 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 269/551] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:15 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:16.861104 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b7e3777a-c757-45ec-8d31-c32d8d0963cd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.995639 Aug 29 23:55:16.863825 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 283/552] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:15 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:16.864846 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:16.865979 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:16.877787 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:16.878873 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:16.882509 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:16.884732 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:16.886264 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:16.888270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-689e525b-2085-4674-9c34-f4e2c2e78f72 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-860543102"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:16.889167 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-689e525b-2085-4674-9c34-f4e2c2e78f72 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:16.892857 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:16.911053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-689e525b-2085-4674-9c34-f4e2c2e78f72 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:16.911235 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-689e525b-2085-4674-9c34-f4e2c2e78f72 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:16.912152 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-689e525b-2085-4674-9c34-f4e2c2e78f72 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:16.912414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-689e525b-2085-4674-9c34-f4e2c2e78f72 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:16.922229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-689e525b-2085-4674-9c34-f4e2c2e78f72 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:16.923005 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-689e525b-2085-4674-9c34-f4e2c2e78f72 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:16.992227 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:16.993466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:16.994106 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:16.994986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lazy-loading 'fault' on Instance uuid b57d3d9f-7fe5-45b7-8e55-2652336c453b {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:55:17.189842 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:17.220492 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-72f49567-89f3-4d99-8305-9b5264286a23 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1332 microversion: 2.1 time: 0.369402 Aug 29 23:55:17.222168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 270/553] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:16 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1332 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:17.530576 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.network.security_group_api [None req-689e525b-2085-4674-9c34-f4e2c2e78f72 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Adding security group 723296f3-4626-4b62-901e-ad88d9e088cf to port 4bfeae22-1324-4d1f-9b5f-0d481c03c512 Aug 29 23:55:17.885979 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:17.890718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:17.919293 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:17.924228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:17.924228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:17.924228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:17.924725 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:17.928090 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.222674 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:18.233161 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:18.235571 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:18.236069 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-baf6d0e4-5e23-42e6-9302-a310d6f84d35 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.357782 Aug 29 23:55:18.236960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 271/554] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:17 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:18.242276 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7d471802-b6bc-4afd-8b7f-1cce13bba6eb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:18.242914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7d471802-b6bc-4afd-8b7f-1cce13bba6eb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:18.249461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d471802-b6bc-4afd-8b7f-1cce13bba6eb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:18.250207 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d471802-b6bc-4afd-8b7f-1cce13bba6eb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:18.250840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d471802-b6bc-4afd-8b7f-1cce13bba6eb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.251740 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d471802-b6bc-4afd-8b7f-1cce13bba6eb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:18.252445 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d471802-b6bc-4afd-8b7f-1cce13bba6eb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:18.253061 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7d471802-b6bc-4afd-8b7f-1cce13bba6eb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.324334 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-689e525b-2085-4674-9c34-f4e2c2e78f72 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "POST /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/action" status: 202 len: 0 microversion: 2.1 time: 1.450241 Aug 29 23:55:18.325135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 284/555] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:55:16 2022] POST /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/action => generated 0 bytes in 1460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:55:18.330962 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:18.331903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:18.353470 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:18.354777 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:18.355731 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.356813 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:18.358457 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:18.359053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.407429 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:18.408223 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:18.408851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.409578 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lazy-loading 'fault' on Instance uuid b57d3d9f-7fe5-45b7-8e55-2652336c453b {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:55:18.496734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:18.514221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b8d538bc-2c02-45ad-b214-c0b655c86773 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 200 len: 1332 microversion: 2.1 time: 0.185356 Aug 29 23:55:18.516354 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 285/556] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:18 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 1332 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:18.530753 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-77d35f70-824f-4d05-a0f8-bc67eb9420a5 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:18.537279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-77d35f70-824f-4d05-a0f8-bc67eb9420a5 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:18.555111 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77d35f70-824f-4d05-a0f8-bc67eb9420a5 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:18.557503 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77d35f70-824f-4d05-a0f8-bc67eb9420a5 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:18.558882 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77d35f70-824f-4d05-a0f8-bc67eb9420a5 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.562681 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77d35f70-824f-4d05-a0f8-bc67eb9420a5 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:18.564011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77d35f70-824f-4d05-a0f8-bc67eb9420a5 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:18.565311 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77d35f70-824f-4d05-a0f8-bc67eb9420a5 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.652940 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7d471802-b6bc-4afd-8b7f-1cce13bba6eb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:18.665127 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7d471802-b6bc-4afd-8b7f-1cce13bba6eb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1734 microversion: 2.1 time: 0.427087 Aug 29 23:55:18.665726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 272/557] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:18 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1734 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:18.678806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-9692389f-b18f-4345-87c5-886b9adb48c8 req-4129ce3d-fdb4-4dc8-ab78-ad0d0dec6762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80567224-9d47-4087-b154-85564c2987cd", "tag": "4bfeae22-1324-4d1f-9b5f-0d481c03c512"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:18.699222 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-9692389f-b18f-4345-87c5-886b9adb48c8 req-4129ce3d-fdb4-4dc8-ab78-ad0d0dec6762 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:18.699712 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-9692389f-b18f-4345-87c5-886b9adb48c8 req-4129ce3d-fdb4-4dc8-ab78-ad0d0dec6762 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:18.700149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-9692389f-b18f-4345-87c5-886b9adb48c8 req-4129ce3d-fdb4-4dc8-ab78-ad0d0dec6762 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:18.725051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-9692389f-b18f-4345-87c5-886b9adb48c8 req-4129ce3d-fdb4-4dc8-ab78-ad0d0dec6762 service nova] Creating event network-changed:4bfeae22-1324-4d1f-9b5f-0d481c03c512 for instance 80567224-9d47-4087-b154-85564c2987cd on hv-cinder-85427 Aug 29 23:55:18.738779 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-9692389f-b18f-4345-87c5-886b9adb48c8 req-4129ce3d-fdb4-4dc8-ab78-ad0d0dec6762 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071746 Aug 29 23:55:18.740262 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 273/558] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:19.112278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-77d35f70-824f-4d05-a0f8-bc67eb9420a5 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:19.142021 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-77d35f70-824f-4d05-a0f8-bc67eb9420a5 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1759 microversion: 2.1 time: 0.623891 Aug 29 23:55:19.144228 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 286/559] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:18 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1759 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:19.297264 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:19.304810 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:19.323820 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:19.326596 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:19.334502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:19.334502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:19.334502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:19.334502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:19.538078 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:19.539819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:19.550996 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:19.552432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:19.553246 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:19.554037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:19.554717 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:19.555372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:19.573799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b HTTP/1.1 Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:55:19.575718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:55:19.577291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'b57d3d9f-7fe5-45b7-8e55-2652336c453b'} Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:55:19.578292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:55:19.579708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:19.581221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:55:19.581221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0f30fbb1-026f-47e4-beeb-8b5e1cae4ab4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 404 len: 111 microversion: 2.1 time: 0.045827 Aug 29 23:55:19.581221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 287/560] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:19 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:55:19.589817 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-654b6218-9e9a-4352-8a58-91c991318074 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '.version_select at 0x7fabbdd66940>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:19.702297 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-654b6218-9e9a-4352-8a58-91c991318074 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932580553" status: 202 len: 0 microversion: 2.1 time: 0.116269 Aug 29 23:55:19.705689 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:19.707513 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 288/561] 10.222.0.58 () {58 vars in 1221 bytes} [Mon Aug 29 23:55:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1932580553 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:55:19.713847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-cc8a5f0e-0479-45f5-8ae8-21bb0c6fbccf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:19.718372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-cc8a5f0e-0479-45f5-8ae8-21bb0c6fbccf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:19.722723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cc8a5f0e-0479-45f5-8ae8-21bb0c6fbccf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:19.723696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cc8a5f0e-0479-45f5-8ae8-21bb0c6fbccf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:19.724060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cc8a5f0e-0479-45f5-8ae8-21bb0c6fbccf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:19.724948 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cc8a5f0e-0479-45f5-8ae8-21bb0c6fbccf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:19.725466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cc8a5f0e-0479-45f5-8ae8-21bb0c6fbccf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:19.726178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cc8a5f0e-0479-45f5-8ae8-21bb0c6fbccf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:19.727977 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:19.729434 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:19.730672 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9d1c0f69-ab05-44b8-809d-c7eed331b6b6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.451811 Aug 29 23:55:19.735011 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 274/562] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:19 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:19.759172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:20.083243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-cc8a5f0e-0479-45f5-8ae8-21bb0c6fbccf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:20.094461 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-cc8a5f0e-0479-45f5-8ae8-21bb0c6fbccf tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1714 microversion: 2.1 time: 0.385750 Aug 29 23:55:20.095481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 289/563] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:19 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1714 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:20.250093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:20.251371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:20.258820 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:20.259861 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:20.260355 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:20.261469 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:20.262714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:20.262911 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:20.407593 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] HTTP exception thrown: Cannot 'detach_volume' instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 while it is in vm_state rescued Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Request method failure captured: Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: DELETE /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments/7dd8f320-dd8f-4a2c-bbf6-bbd70147e16e HTTP/1.1 Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD4v-eu6rZBlAlqzwBcCkUx2NN4-TegknEgxG_yMBpHgCTjDu6aYx-1CgSWLVYCiicIRI8khSsWFJTLENz4gGINoHk92r89UKQyas6aJSylF_6htN8yd_yfF4ND3Mc7ip6d7BUL4TD_MMjoD6qH6Ivg1CAG_Ywi9Vp6la1BTmcb1Ak Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: cb38bc3ae5c14e4c8385809d84573600 Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:55:20.409294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb38bc3ae5c14e4c8385809d84573600", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: cb38bc3ae5c14e4c8385809d84573600 Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-ServerRescueNegativeTestJSON-660246268-project Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 734d44438bfb4a79a68aa6705e49b1e9 Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-ServerRescueNegativeTestJSON-660246268-project Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:55:20.410968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Cannot 'detach_volume' instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 while it is in vm_state rescued Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'server_id': '5c3a360a-1fe2-45f0-ad59-f9e69381ac28', 'id': '7dd8f320-dd8f-4a2c-bbf6-bbd70147e16e'} Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:55:20.411969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 while it is in vm_state rescued Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 while it is in vm_state rescued Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:55:20.413727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Returning 409 to user: Cannot 'detach_volume' instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 while it is in vm_state rescued {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:55:20.414995 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-84e67275-f86b-4bac-8b1e-89d115931215 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments/7dd8f320-dd8f-4a2c-bbf6-bbd70147e16e" status: 409 len: 152 microversion: 2.1 time: 0.167687 Aug 29 23:55:20.414995 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 275/564] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Aug 29 23:55:20 2022] DELETE /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments/7dd8f320-dd8f-4a2c-bbf6-bbd70147e16e => generated 152 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 23:55:20.420341 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fa2164c1-b336-4c34-9e29-616a467eb8b4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:20.420870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fa2164c1-b336-4c34-9e29-616a467eb8b4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:20.428040 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fa2164c1-b336-4c34-9e29-616a467eb8b4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:20.436578 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fa2164c1-b336-4c34-9e29-616a467eb8b4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:20.436578 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fa2164c1-b336-4c34-9e29-616a467eb8b4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:20.436578 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fa2164c1-b336-4c34-9e29-616a467eb8b4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:20.436578 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fa2164c1-b336-4c34-9e29-616a467eb8b4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:20.437143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fa2164c1-b336-4c34-9e29-616a467eb8b4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:20.647565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fa2164c1-b336-4c34-9e29-616a467eb8b4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "POST /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/action" status: 202 len: 0 microversion: 2.1 time: 0.230897 Aug 29 23:55:20.650001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 290/565] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:55:20 2022] POST /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:55:20.666843 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1b12c0a8-cc95-46f5-b91c-c40294b424e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:20.668031 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1b12c0a8-cc95-46f5-b91c-c40294b424e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:20.677943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b12c0a8-cc95-46f5-b91c-c40294b424e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:20.677943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b12c0a8-cc95-46f5-b91c-c40294b424e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:20.677943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b12c0a8-cc95-46f5-b91c-c40294b424e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:20.677943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b12c0a8-cc95-46f5-b91c-c40294b424e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:20.678272 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b12c0a8-cc95-46f5-b91c-c40294b424e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:20.678272 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b12c0a8-cc95-46f5-b91c-c40294b424e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:20.689065 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c6d57f0d-1b01-4d57-8365-878f25a11e54 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:20.689662 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c6d57f0d-1b01-4d57-8365-878f25a11e54 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:20.696766 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6d57f0d-1b01-4d57-8365-878f25a11e54 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:20.697298 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6d57f0d-1b01-4d57-8365-878f25a11e54 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:20.697760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6d57f0d-1b01-4d57-8365-878f25a11e54 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:20.698521 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6d57f0d-1b01-4d57-8365-878f25a11e54 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:20.698971 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6d57f0d-1b01-4d57-8365-878f25a11e54 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:20.699538 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c6d57f0d-1b01-4d57-8365-878f25a11e54 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:20.795765 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-c6d57f0d-1b01-4d57-8365-878f25a11e54 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lazy-loading 'services' on Instance uuid 32036006-145d-499d-848e-16bd2f8f9abf {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:55:21.060345 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c6d57f0d-1b01-4d57-8365-878f25a11e54 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments/9935689c-45c6-4768-948f-69b24cd6cc87" status: 202 len: 0 microversion: 2.1 time: 0.375793 Aug 29 23:55:21.060938 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 291/566] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Aug 29 23:55:20 2022] DELETE /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments/9935689c-45c6-4768-948f-69b24cd6cc87 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:55:21.070732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:21.071432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:21.077661 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:21.078145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:21.078615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:21.079371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:21.079822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:21.080237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:21.087147 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1b12c0a8-cc95-46f5-b91c-c40294b424e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:21.095796 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1b12c0a8-cc95-46f5-b91c-c40294b424e5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1722 microversion: 2.1 time: 0.437406 Aug 29 23:55:21.096368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 276/567] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:20 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:21.108246 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c2542725-fa47-4362-9622-a2bb12e47420 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:21.110588 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c2542725-fa47-4362-9622-a2bb12e47420 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:21.117148 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c2542725-fa47-4362-9622-a2bb12e47420 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:21.117624 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c2542725-fa47-4362-9622-a2bb12e47420 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:21.118058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c2542725-fa47-4362-9622-a2bb12e47420 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:21.118777 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c2542725-fa47-4362-9622-a2bb12e47420 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:21.119221 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c2542725-fa47-4362-9622-a2bb12e47420 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:21.119635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c2542725-fa47-4362-9622-a2bb12e47420 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:21.156878 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c2542725-fa47-4362-9622-a2bb12e47420 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057240 Aug 29 23:55:21.157478 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 277/568] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:55:21 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:21.237120 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:21.246205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:21.247676 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:21.248843 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-061f997e-6bcb-4cc9-aa23-2ce5d5705ad3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.183333 Aug 29 23:55:21.249391 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 292/569] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:21 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:22.117848 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-09110915-216d-4764-ae35-64fb7e2b667a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:22.122471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-09110915-216d-4764-ae35-64fb7e2b667a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:22.125012 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-09110915-216d-4764-ae35-64fb7e2b667a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:22.125489 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-09110915-216d-4764-ae35-64fb7e2b667a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:22.125923 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-09110915-216d-4764-ae35-64fb7e2b667a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:22.126651 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-09110915-216d-4764-ae35-64fb7e2b667a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:22.127100 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-09110915-216d-4764-ae35-64fb7e2b667a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:22.127517 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-09110915-216d-4764-ae35-64fb7e2b667a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:22.170098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ec19a0da-0334-44c3-b8f2-27b09d32fbed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:22.172553 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ec19a0da-0334-44c3-b8f2-27b09d32fbed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:22.180981 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec19a0da-0334-44c3-b8f2-27b09d32fbed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:22.181471 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec19a0da-0334-44c3-b8f2-27b09d32fbed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:22.181907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec19a0da-0334-44c3-b8f2-27b09d32fbed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:22.182657 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec19a0da-0334-44c3-b8f2-27b09d32fbed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:22.183200 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec19a0da-0334-44c3-b8f2-27b09d32fbed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:22.183560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ec19a0da-0334-44c3-b8f2-27b09d32fbed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:22.221011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ec19a0da-0334-44c3-b8f2-27b09d32fbed tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055363 Aug 29 23:55:22.221584 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 293/570] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:55:22 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:22.272210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:22.272818 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:22.279067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:22.279551 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:22.280018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:22.280759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:22.281318 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:22.281638 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:22.326557 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-09110915-216d-4764-ae35-64fb7e2b667a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:22.335164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-09110915-216d-4764-ae35-64fb7e2b667a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1722 microversion: 2.1 time: 0.221808 Aug 29 23:55:22.335754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 278/571] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:22 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:22.425609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:22.435486 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:22.437015 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:22.438188 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fee9aae5-c050-4f15-91ca-1e38569a7ca1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.170005 Aug 29 23:55:22.438833 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 294/572] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:22 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:23.233645 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-59dfcc1b-8fe5-475f-915a-479d2cde49b0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:23.235905 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-59dfcc1b-8fe5-475f-915a-479d2cde49b0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:23.242468 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-59dfcc1b-8fe5-475f-915a-479d2cde49b0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:23.248037 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-59dfcc1b-8fe5-475f-915a-479d2cde49b0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:23.248037 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-59dfcc1b-8fe5-475f-915a-479d2cde49b0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:23.248037 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-59dfcc1b-8fe5-475f-915a-479d2cde49b0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:23.248037 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-59dfcc1b-8fe5-475f-915a-479d2cde49b0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:23.248385 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-59dfcc1b-8fe5-475f-915a-479d2cde49b0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:23.277008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-59dfcc1b-8fe5-475f-915a-479d2cde49b0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047530 Aug 29 23:55:23.277587 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 279/573] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:55:23 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:23.357351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8c997ce7-9e14-4f8c-ad8a-b498b1f363fb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:23.357957 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8c997ce7-9e14-4f8c-ad8a-b498b1f363fb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:23.364497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c997ce7-9e14-4f8c-ad8a-b498b1f363fb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:23.365018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c997ce7-9e14-4f8c-ad8a-b498b1f363fb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:23.365408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c997ce7-9e14-4f8c-ad8a-b498b1f363fb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:23.366099 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c997ce7-9e14-4f8c-ad8a-b498b1f363fb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:23.366577 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c997ce7-9e14-4f8c-ad8a-b498b1f363fb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:23.367007 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8c997ce7-9e14-4f8c-ad8a-b498b1f363fb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:23.462626 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:23.463075 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:23.469743 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:23.470231 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:23.470698 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:23.471399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:23.471842 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:23.472256 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:23.530214 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8c997ce7-9e14-4f8c-ad8a-b498b1f363fb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:23.539988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8c997ce7-9e14-4f8c-ad8a-b498b1f363fb tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1722 microversion: 2.1 time: 0.186363 Aug 29 23:55:23.540675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 295/574] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:23 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:23.627157 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:23.643363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:23.644808 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:23.646020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2541a0c7-1b5b-4375-bb29-6f3dddcb24cf tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.188741 Aug 29 23:55:23.646753 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 280/575] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:23 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:24.291539 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-533eb85f-b84a-410c-bc4b-6fb5b781e826 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:24.295186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-533eb85f-b84a-410c-bc4b-6fb5b781e826 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:24.302870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-533eb85f-b84a-410c-bc4b-6fb5b781e826 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:24.303581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-533eb85f-b84a-410c-bc4b-6fb5b781e826 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:24.304201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-533eb85f-b84a-410c-bc4b-6fb5b781e826 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:24.304918 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-533eb85f-b84a-410c-bc4b-6fb5b781e826 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:24.305373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-533eb85f-b84a-410c-bc4b-6fb5b781e826 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:24.305830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-533eb85f-b84a-410c-bc4b-6fb5b781e826 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:24.339498 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-533eb85f-b84a-410c-bc4b-6fb5b781e826 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053888 Aug 29 23:55:24.340848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 296/576] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:55:24 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:24.562728 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-202daac5-9316-49be-9d74-2b2a1d57cbb3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:24.563389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-202daac5-9316-49be-9d74-2b2a1d57cbb3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:24.570632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-202daac5-9316-49be-9d74-2b2a1d57cbb3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:24.571126 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-202daac5-9316-49be-9d74-2b2a1d57cbb3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:24.575122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-202daac5-9316-49be-9d74-2b2a1d57cbb3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:24.575122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-202daac5-9316-49be-9d74-2b2a1d57cbb3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:24.575122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-202daac5-9316-49be-9d74-2b2a1d57cbb3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:24.575122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-202daac5-9316-49be-9d74-2b2a1d57cbb3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:24.689964 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:24.691159 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:24.701682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:24.702577 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:24.703137 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:24.705030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:24.705629 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:24.706186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:24.742135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-202daac5-9316-49be-9d74-2b2a1d57cbb3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:24.750541 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-202daac5-9316-49be-9d74-2b2a1d57cbb3 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1722 microversion: 2.1 time: 0.192055 Aug 29 23:55:24.765046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 281/577] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:24 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:24.901796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:24.914594 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:24.916580 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:24.918018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-bd0d3f9d-f7ca-43b9-8a20-ecaf39d4d483 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.247776 Aug 29 23:55:24.918624 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 297/578] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:24 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:25.353998 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e7148b55-810c-4e36-8779-ee8f2b91adf7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:25.359349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e7148b55-810c-4e36-8779-ee8f2b91adf7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:25.363440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e7148b55-810c-4e36-8779-ee8f2b91adf7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:25.364548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e7148b55-810c-4e36-8779-ee8f2b91adf7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:25.365097 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e7148b55-810c-4e36-8779-ee8f2b91adf7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:25.365864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e7148b55-810c-4e36-8779-ee8f2b91adf7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:25.366446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e7148b55-810c-4e36-8779-ee8f2b91adf7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:25.366881 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e7148b55-810c-4e36-8779-ee8f2b91adf7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:25.382577 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:25.401565 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e7148b55-810c-4e36-8779-ee8f2b91adf7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052127 Aug 29 23:55:25.402158 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 282/579] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:55:25 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 23:55:25.515979 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-95f8bd4b-08f3-4932-9513-0d961edcaa42 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:25.516831 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-95f8bd4b-08f3-4932-9513-0d961edcaa42 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:25.527273 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95f8bd4b-08f3-4932-9513-0d961edcaa42 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:25.528088 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95f8bd4b-08f3-4932-9513-0d961edcaa42 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:25.528797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95f8bd4b-08f3-4932-9513-0d961edcaa42 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:25.529977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95f8bd4b-08f3-4932-9513-0d961edcaa42 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:25.530895 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95f8bd4b-08f3-4932-9513-0d961edcaa42 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:25.531544 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-95f8bd4b-08f3-4932-9513-0d961edcaa42 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:25.578137 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-95f8bd4b-08f3-4932-9513-0d961edcaa42 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:55:25.774706 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f4d174ed-071c-4664-8726-d8b3af1d1c52 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:25.775346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f4d174ed-071c-4664-8726-d8b3af1d1c52 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:25.782283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4d174ed-071c-4664-8726-d8b3af1d1c52 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:25.782786 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4d174ed-071c-4664-8726-d8b3af1d1c52 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:25.783201 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4d174ed-071c-4664-8726-d8b3af1d1c52 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:25.783923 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4d174ed-071c-4664-8726-d8b3af1d1c52 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:25.784379 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4d174ed-071c-4664-8726-d8b3af1d1c52 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:25.784809 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4d174ed-071c-4664-8726-d8b3af1d1c52 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:25.906014 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-95f8bd4b-08f3-4932-9513-0d961edcaa42 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 204 len: 0 microversion: 2.1 time: 0.396863 Aug 29 23:55:25.911329 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 298/580] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:55:25 2022] DELETE /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:55:25.916817 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-35b2b4df-efbd-4681-a3f8-fd5e44a1290c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:25.917548 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-35b2b4df-efbd-4681-a3f8-fd5e44a1290c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:25.924474 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-35b2b4df-efbd-4681-a3f8-fd5e44a1290c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:25.924968 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-35b2b4df-efbd-4681-a3f8-fd5e44a1290c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:25.925412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-35b2b4df-efbd-4681-a3f8-fd5e44a1290c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:25.926308 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-35b2b4df-efbd-4681-a3f8-fd5e44a1290c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:25.926986 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-35b2b4df-efbd-4681-a3f8-fd5e44a1290c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:25.927563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-35b2b4df-efbd-4681-a3f8-fd5e44a1290c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:26.039769 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f4d174ed-071c-4664-8726-d8b3af1d1c52 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:26.057718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f4d174ed-071c-4664-8726-d8b3af1d1c52 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1728 microversion: 2.1 time: 0.288027 Aug 29 23:55:26.058491 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 283/581] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:25 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1728 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:26.070774 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:26.072732 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:26.085204 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:26.086449 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:26.087426 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:26.088950 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:26.089781 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:26.090586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:26.184994 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-35b2b4df-efbd-4681-a3f8-fd5e44a1290c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:26.195157 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-35b2b4df-efbd-4681-a3f8-fd5e44a1290c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1682 microversion: 2.1 time: 0.282431 Aug 29 23:55:26.196310 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 299/582] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:25 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1682 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:26.202500 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-053ff421-bb0d-4bbc-b7fa-d10725ec0d1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:26.203619 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-053ff421-bb0d-4bbc-b7fa-d10725ec0d1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:26.213113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-053ff421-bb0d-4bbc-b7fa-d10725ec0d1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:26.214134 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-053ff421-bb0d-4bbc-b7fa-d10725ec0d1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:26.214870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-053ff421-bb0d-4bbc-b7fa-d10725ec0d1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:26.215892 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-053ff421-bb0d-4bbc-b7fa-d10725ec0d1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:26.216595 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-053ff421-bb0d-4bbc-b7fa-d10725ec0d1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:26.217243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-053ff421-bb0d-4bbc-b7fa-d10725ec0d1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:26.387479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-053ff421-bb0d-4bbc-b7fa-d10725ec0d1d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189091 Aug 29 23:55:26.388531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 300/583] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Aug 29 23:55:26 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:26.397437 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-44edd81e-64ce-4b20-87f7-61fe3fa39fbe req-deac45e3-4f6c-4553-88a9-a0f4770b6d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781bf4fc-f6e6-4efc-b757-5888339b6b3c", "name": "network-vif-plugged", "status": "completed", "tag": "70011c53-2246-46a9-9308-734ee213614a"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:26.400464 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:26.413753 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-44edd81e-64ce-4b20-87f7-61fe3fa39fbe req-deac45e3-4f6c-4553-88a9-a0f4770b6d4a service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:26.414894 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-44edd81e-64ce-4b20-87f7-61fe3fa39fbe req-deac45e3-4f6c-4553-88a9-a0f4770b6d4a service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:26.415396 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-44edd81e-64ce-4b20-87f7-61fe3fa39fbe req-deac45e3-4f6c-4553-88a9-a0f4770b6d4a service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:26.421270 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:26.424838 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:26.430263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-eb608a2d-6950-4e24-a9bc-6086e24202f8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.368288 Aug 29 23:55:26.430263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 284/584] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:26 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:26.430927 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-44edd81e-64ce-4b20-87f7-61fe3fa39fbe req-deac45e3-4f6c-4553-88a9-a0f4770b6d4a service nova] Creating event network-vif-plugged:70011c53-2246-46a9-9308-734ee213614a for instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c on hv-cinder-85427 Aug 29 23:55:26.436435 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-44edd81e-64ce-4b20-87f7-61fe3fa39fbe req-deac45e3-4f6c-4553-88a9-a0f4770b6d4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046130 Aug 29 23:55:26.437037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 301/585] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:27.229738 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-438ab8c9-7a19-44b9-9895-54d621f3f389 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:27.230440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-438ab8c9-7a19-44b9-9895-54d621f3f389 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:27.237509 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-438ab8c9-7a19-44b9-9895-54d621f3f389 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:27.238009 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-438ab8c9-7a19-44b9-9895-54d621f3f389 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:27.238496 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-438ab8c9-7a19-44b9-9895-54d621f3f389 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:27.240092 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-438ab8c9-7a19-44b9-9895-54d621f3f389 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:27.240702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-438ab8c9-7a19-44b9-9895-54d621f3f389 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:27.241128 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-438ab8c9-7a19-44b9-9895-54d621f3f389 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:27.472565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:27.474978 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:27.487513 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:27.488370 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:27.489268 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:27.490593 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:27.491403 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:27.492158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:27.535101 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-438ab8c9-7a19-44b9-9895-54d621f3f389 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:27.545755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-438ab8c9-7a19-44b9-9895-54d621f3f389 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1682 microversion: 2.1 time: 0.319789 Aug 29 23:55:27.546912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 285/586] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:27 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1682 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:27.760906 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:27.772411 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:27.774593 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:27.776118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e6935155-bb5d-469a-8c0d-948f50f5c365 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.310462 Aug 29 23:55:27.777132 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 302/587] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:27 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:27.862035 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-f79e8a31-e189-498c-81a8-8a5078f8d4ad req-f05a2576-bc7f-40eb-a47b-c8fcafb29a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c3a360a-1fe2-45f0-ad59-f9e69381ac28", "tag": "4496c220-d785-47cc-8a05-42c8832bf15c"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:27.873472 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-f79e8a31-e189-498c-81a8-8a5078f8d4ad req-f05a2576-bc7f-40eb-a47b-c8fcafb29a32 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:27.874092 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-f79e8a31-e189-498c-81a8-8a5078f8d4ad req-f05a2576-bc7f-40eb-a47b-c8fcafb29a32 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:27.875643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-f79e8a31-e189-498c-81a8-8a5078f8d4ad req-f05a2576-bc7f-40eb-a47b-c8fcafb29a32 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:27.888778 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-f79e8a31-e189-498c-81a8-8a5078f8d4ad req-f05a2576-bc7f-40eb-a47b-c8fcafb29a32 service nova] Creating event network-changed:4496c220-d785-47cc-8a05-42c8832bf15c for instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 on hv-cinder-85427 Aug 29 23:55:27.894720 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-f79e8a31-e189-498c-81a8-8a5078f8d4ad req-f05a2576-bc7f-40eb-a47b-c8fcafb29a32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036475 Aug 29 23:55:27.895574 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 286/588] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:28.570029 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ee1d5b76-f586-4e9d-8774-b287e26547b6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:28.570877 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ee1d5b76-f586-4e9d-8774-b287e26547b6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:28.579154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b76-f586-4e9d-8774-b287e26547b6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:28.579651 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b76-f586-4e9d-8774-b287e26547b6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:28.580090 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b76-f586-4e9d-8774-b287e26547b6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:28.580799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b76-f586-4e9d-8774-b287e26547b6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:28.581246 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b76-f586-4e9d-8774-b287e26547b6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:28.581653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b76-f586-4e9d-8774-b287e26547b6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:28.809130 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:28.811416 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:28.818897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:28.819705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:28.820315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:28.821059 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:28.821512 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:28.821939 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:29.155868 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ee1d5b76-f586-4e9d-8774-b287e26547b6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:29.166909 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:29.173216 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ee1d5b76-f586-4e9d-8774-b287e26547b6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1682 microversion: 2.1 time: 0.608074 Aug 29 23:55:29.174484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 303/589] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:28 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1682 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:29.208988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:29.219069 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:29.220615 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:29.222038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-70ddce75-e957-4a5a-bfe7-2f4081d0cfb4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.417901 Aug 29 23:55:29.228033 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 287/590] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:28 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:30.158060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-1cdb27f8-027e-44ab-ae24-e96ab80d8139 req-6718accc-e325-408e-944d-8ddbf86d3871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c3a360a-1fe2-45f0-ad59-f9e69381ac28", "tag": "4496c220-d785-47cc-8a05-42c8832bf15c"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:30.174506 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-1cdb27f8-027e-44ab-ae24-e96ab80d8139 req-6718accc-e325-408e-944d-8ddbf86d3871 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:30.175341 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-1cdb27f8-027e-44ab-ae24-e96ab80d8139 req-6718accc-e325-408e-944d-8ddbf86d3871 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:30.176509 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-1cdb27f8-027e-44ab-ae24-e96ab80d8139 req-6718accc-e325-408e-944d-8ddbf86d3871 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:30.196377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-1cdb27f8-027e-44ab-ae24-e96ab80d8139 req-6718accc-e325-408e-944d-8ddbf86d3871 service nova] Creating event network-changed:4496c220-d785-47cc-8a05-42c8832bf15c for instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 on hv-cinder-85427 Aug 29 23:55:30.198027 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b300522b-e6a9-413f-9726-82b9e2e904db tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:30.198710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b300522b-e6a9-413f-9726-82b9e2e904db tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:30.204561 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-1cdb27f8-027e-44ab-ae24-e96ab80d8139 req-6718accc-e325-408e-944d-8ddbf86d3871 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055490 Aug 29 23:55:30.204561 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 304/591] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:30.206229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b300522b-e6a9-413f-9726-82b9e2e904db tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:30.206792 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b300522b-e6a9-413f-9726-82b9e2e904db tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:30.207245 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b300522b-e6a9-413f-9726-82b9e2e904db tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:30.208598 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b300522b-e6a9-413f-9726-82b9e2e904db tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:30.208966 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b300522b-e6a9-413f-9726-82b9e2e904db tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:30.210166 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b300522b-e6a9-413f-9726-82b9e2e904db tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:30.247979 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:30.248718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:30.257533 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:30.258312 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:30.258982 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:30.259905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:30.260584 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:30.261176 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:30.349956 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b300522b-e6a9-413f-9726-82b9e2e904db tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:30.361904 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b300522b-e6a9-413f-9726-82b9e2e904db tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1614 microversion: 2.1 time: 0.168083 Aug 29 23:55:30.364382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 288/592] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:30 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1614 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:30.794148 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:30.810361 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:30.812220 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:30.813573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-14818180-4588-4c2d-bd12-393028055027 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.570036 Aug 29 23:55:30.814640 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 305/593] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:30 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:31.397198 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-94c323b3-8690-41d5-855c-06d0de47a112 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:31.400920 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-94c323b3-8690-41d5-855c-06d0de47a112 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:31.403064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:31.404155 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:31.436090 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.446626 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94c323b3-8690-41d5-855c-06d0de47a112 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.447192 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94c323b3-8690-41d5-855c-06d0de47a112 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.447880 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94c323b3-8690-41d5-855c-06d0de47a112 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:31.449086 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94c323b3-8690-41d5-855c-06d0de47a112 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.449528 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.450370 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:31.451548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.452265 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.453002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:31.455100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94c323b3-8690-41d5-855c-06d0de47a112 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.466759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94c323b3-8690-41d5-855c-06d0de47a112 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:31.552298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.553685 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.555160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:31.556086 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lazy-loading 'fault' on Instance uuid 32036006-145d-499d-848e-16bd2f8f9abf {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:55:31.622852 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:31.633616 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a37e3e76-c29d-412a-9928-e6a3c0fe57f1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 200 len: 1331 microversion: 2.1 time: 0.251480 Aug 29 23:55:31.634664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 289/594] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:31 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 1331 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:31.782574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-94c323b3-8690-41d5-855c-06d0de47a112 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "POST /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/action" status: 202 len: 0 microversion: 2.1 time: 0.391078 Aug 29 23:55:31.789718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 306/595] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:55:31 2022] POST /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:55:31.799499 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e02c6a6f-9afb-48b8-8bc1-7b5758c5c874 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:31.800309 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e02c6a6f-9afb-48b8-8bc1-7b5758c5c874 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:31.817267 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e02c6a6f-9afb-48b8-8bc1-7b5758c5c874 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.817267 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e02c6a6f-9afb-48b8-8bc1-7b5758c5c874 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.817267 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e02c6a6f-9afb-48b8-8bc1-7b5758c5c874 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:31.817267 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e02c6a6f-9afb-48b8-8bc1-7b5758c5c874 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.817979 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e02c6a6f-9afb-48b8-8bc1-7b5758c5c874 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.817979 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e02c6a6f-9afb-48b8-8bc1-7b5758c5c874 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:31.843585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:31.843585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:31.845619 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:31.851612 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.852113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.852558 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:31.853275 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:31.853920 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:31.854352 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:32.139215 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e02c6a6f-9afb-48b8-8bc1-7b5758c5c874 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:32.144279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:32.148675 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e02c6a6f-9afb-48b8-8bc1-7b5758c5c874 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1751 microversion: 2.1 time: 0.356987 Aug 29 23:55:32.149309 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 290/596] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:31 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1751 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:32.169462 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:32.180159 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:32.182144 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-75d8e318-4ed7-4218-85ad-64655e3480e6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1807 microversion: 2.20 time: 0.344354 Aug 29 23:55:32.183126 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 307/597] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:31 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1807 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:55:32.223111 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-ee2992c2-8061-4525-9839-2f1de295ce8f req-e6532196-ffb3-4b7c-8330-5caf92a43bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32036006-145d-499d-848e-16bd2f8f9abf", "name": "network-vif-deleted", "tag": "01e67dee-c059-44c0-b274-3278a508338c"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:32.233682 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ee2992c2-8061-4525-9839-2f1de295ce8f req-e6532196-ffb3-4b7c-8330-5caf92a43bb8 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:32.237960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ee2992c2-8061-4525-9839-2f1de295ce8f req-e6532196-ffb3-4b7c-8330-5caf92a43bb8 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:32.237960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ee2992c2-8061-4525-9839-2f1de295ce8f req-e6532196-ffb3-4b7c-8330-5caf92a43bb8 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:32.249286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-ee2992c2-8061-4525-9839-2f1de295ce8f req-e6532196-ffb3-4b7c-8330-5caf92a43bb8 service nova] Creating event network-vif-deleted:01e67dee-c059-44c0-b274-3278a508338c for instance 32036006-145d-499d-848e-16bd2f8f9abf on hv-cinder-85427 Aug 29 23:55:32.255397 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-ee2992c2-8061-4525-9839-2f1de295ce8f req-e6532196-ffb3-4b7c-8330-5caf92a43bb8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035979 Aug 29 23:55:32.256013 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 291/598] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:32.665502 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:32.666391 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:32.673841 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:32.674605 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:32.680686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:32.680686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:32.680686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:32.680686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:32.693666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf HTTP/1.1 Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:55:32.695388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:55:32.696794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '32036006-145d-499d-848e-16bd2f8f9abf'} Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:55:32.697834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:55:32.703949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:32.705321 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:55:32.705321 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e4bc152c-ebeb-433c-bc4b-2116d0e3298b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 404 len: 111 microversion: 2.1 time: 0.036252 Aug 29 23:55:32.705321 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 308/599] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:32 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:55:32.709529 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-37cba979-b205-4d07-8354-82e50e2d46f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '.version_select at 0x7fabbdcc38b0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:32.818027 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-37cba979-b205-4d07-8354-82e50e2d46f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-663634174" status: 202 len: 0 microversion: 2.1 time: 0.113822 Aug 29 23:55:32.819024 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 292/600] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Aug 29 23:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-663634174 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:55:33.186622 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1d56cd55-67e1-4241-a16c-45d1dafa0f93 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:33.187227 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1d56cd55-67e1-4241-a16c-45d1dafa0f93 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:33.194697 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d56cd55-67e1-4241-a16c-45d1dafa0f93 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:33.195176 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d56cd55-67e1-4241-a16c-45d1dafa0f93 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:33.195608 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d56cd55-67e1-4241-a16c-45d1dafa0f93 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:33.196317 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d56cd55-67e1-4241-a16c-45d1dafa0f93 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:33.196765 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d56cd55-67e1-4241-a16c-45d1dafa0f93 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:33.197181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1d56cd55-67e1-4241-a16c-45d1dafa0f93 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:33.207374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:33.208317 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:33.215583 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:33.216493 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:33.217002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:33.217879 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:33.218833 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:33.219334 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:33.441431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1d56cd55-67e1-4241-a16c-45d1dafa0f93 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:33.452146 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1d56cd55-67e1-4241-a16c-45d1dafa0f93 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.269328 Aug 29 23:55:33.453322 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 309/601] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:33 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:33.460753 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:33.480357 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:33.481765 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:33.483223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b1161273-b5d9-4dd9-a908-d4f03738567b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1794 microversion: 2.20 time: 0.281247 Aug 29 23:55:33.484106 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 293/602] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:55:33 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1794 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:55:33.729896 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-963f092c-d838-4846-8730-4b5e03a9765f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: .version_select at 0x7fabbdd05430>, body: {"keypair": {"name": "tempest-keypair-1057048236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeMLetdhu7PcCtESSTRlThvP1YM+KB/80Yt8A4+7wJIingYeARtfI39JxyeRgnGB7g0KTJKjuA896sYWlBhY/lKTodd4zepdDwqthV77HM1S4Hf93laFQA2MY4p+VJNnA=="}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:33.747847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-963f092c-d838-4846-8730-4b5e03a9765f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'key_pairs'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:55:33.752463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-963f092c-d838-4846-8730-4b5e03a9765f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for user 34ef7ee27c3948ac9df1ff94ce24618e and project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'key_pairs'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:55:33.845530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-963f092c-d838-4846-8730-4b5e03a9765f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119716 Aug 29 23:55:33.846315 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 310/603] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Aug 29 23:55:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:34.480537 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fcd38977-60bb-42ea-a98b-9a9e5dbfc199 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:34.481401 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-fcd38977-60bb-42ea-a98b-9a9e5dbfc199 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:34.489677 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fcd38977-60bb-42ea-a98b-9a9e5dbfc199 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:34.490172 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fcd38977-60bb-42ea-a98b-9a9e5dbfc199 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:34.490682 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fcd38977-60bb-42ea-a98b-9a9e5dbfc199 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:34.491413 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fcd38977-60bb-42ea-a98b-9a9e5dbfc199 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:34.491870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fcd38977-60bb-42ea-a98b-9a9e5dbfc199 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:34.492297 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fcd38977-60bb-42ea-a98b-9a9e5dbfc199 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:34.761700 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-fcd38977-60bb-42ea-a98b-9a9e5dbfc199 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:34.774999 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-fcd38977-60bb-42ea-a98b-9a9e5dbfc199 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.300242 Aug 29 23:55:34.774999 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 294/604] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:34 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:35.802664 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-166fd809-685a-4e2b-8650-335e307eeaf4 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:35.803823 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-166fd809-685a-4e2b-8650-335e307eeaf4 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:35.814479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-166fd809-685a-4e2b-8650-335e307eeaf4 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:35.815341 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-166fd809-685a-4e2b-8650-335e307eeaf4 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:35.816162 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-166fd809-685a-4e2b-8650-335e307eeaf4 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:35.819417 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-166fd809-685a-4e2b-8650-335e307eeaf4 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:35.820438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-166fd809-685a-4e2b-8650-335e307eeaf4 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:35.821206 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-166fd809-685a-4e2b-8650-335e307eeaf4 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:36.077314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-166fd809-685a-4e2b-8650-335e307eeaf4 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:36.092711 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-166fd809-685a-4e2b-8650-335e307eeaf4 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.297531 Aug 29 23:55:36.104372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 311/605] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:35 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:36.938417 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1091138243", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b596b2d-12e3-47f4-a595-eed3b3358a18"}], "security_groups": [{"name": "tempest-securitygroup--722666270"}], "key_name": "tempest-keypair-1057048236", "user_data": "}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:36.951479 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:37.086062 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] validate_networks() for [('9b596b2d-12e3-47f4-a595-eed3b3358a18', None, None, None, None, None)] {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:55:37.130633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-949da096-ac3d-4c6e-817f-26e7b5e55e44 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:37.131764 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-949da096-ac3d-4c6e-817f-26e7b5e55e44 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:37.144153 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-949da096-ac3d-4c6e-817f-26e7b5e55e44 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:37.145617 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-949da096-ac3d-4c6e-817f-26e7b5e55e44 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:37.146802 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-949da096-ac3d-4c6e-817f-26e7b5e55e44 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:37.148086 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-949da096-ac3d-4c6e-817f-26e7b5e55e44 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:37.149026 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-949da096-ac3d-4c6e-817f-26e7b5e55e44 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:37.149705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-949da096-ac3d-4c6e-817f-26e7b5e55e44 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:37.406350 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-949da096-ac3d-4c6e-817f-26e7b5e55e44 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:37.419165 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-949da096-ac3d-4c6e-817f-26e7b5e55e44 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.296593 Aug 29 23:55:37.420152 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 312/606] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:37 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:37.580669 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:55:37.581182 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:55:37.581663 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:55:37.582073 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:55:37.582509 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:55:37.592091 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:37.592647 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:37.593347 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:37.594094 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:37.594641 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:37.595382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:37.614350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:55:37.618875 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for user 34ef7ee27c3948ac9df1ff94ce24618e and project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:55:37.641098 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:55:37.643584 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:55:37.736625 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7ae2a81b-ef65-4e86-a767-05942607f396 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.802777 Aug 29 23:55:37.737272 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 295/607] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:55:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:55:37.749868 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f9a5a0f9-9868-42f4-90b3-535f3a975f14 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:37.750881 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f9a5a0f9-9868-42f4-90b3-535f3a975f14 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:37.810036 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f9a5a0f9-9868-42f4-90b3-535f3a975f14 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:37.817942 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f9a5a0f9-9868-42f4-90b3-535f3a975f14 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1242 microversion: 2.1 time: 0.071814 Aug 29 23:55:37.818503 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 313/608] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:37 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:38.450982 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5dc8e08d-ad70-4acf-9490-6b0a69ccb024 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:38.451765 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5dc8e08d-ad70-4acf-9490-6b0a69ccb024 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:38.460148 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dc8e08d-ad70-4acf-9490-6b0a69ccb024 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:38.460780 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dc8e08d-ad70-4acf-9490-6b0a69ccb024 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:38.461314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dc8e08d-ad70-4acf-9490-6b0a69ccb024 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:38.462209 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dc8e08d-ad70-4acf-9490-6b0a69ccb024 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:38.463022 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dc8e08d-ad70-4acf-9490-6b0a69ccb024 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:38.463664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dc8e08d-ad70-4acf-9490-6b0a69ccb024 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:38.690074 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5dc8e08d-ad70-4acf-9490-6b0a69ccb024 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:38.701778 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5dc8e08d-ad70-4acf-9490-6b0a69ccb024 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.255682 Aug 29 23:55:38.702664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 296/609] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:38 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:38.840956 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f4eda82a-494e-4752-922f-ff006338dfc5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:38.841932 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f4eda82a-494e-4752-922f-ff006338dfc5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:38.850283 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4eda82a-494e-4752-922f-ff006338dfc5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:38.850848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4eda82a-494e-4752-922f-ff006338dfc5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:38.851288 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4eda82a-494e-4752-922f-ff006338dfc5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:38.856754 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4eda82a-494e-4752-922f-ff006338dfc5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:38.856754 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4eda82a-494e-4752-922f-ff006338dfc5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:38.856754 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4eda82a-494e-4752-922f-ff006338dfc5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:38.928093 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f4eda82a-494e-4752-922f-ff006338dfc5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:38.939724 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f4eda82a-494e-4752-922f-ff006338dfc5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1246 microversion: 2.1 time: 0.104551 Aug 29 23:55:38.940467 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 314/610] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:38 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:39.733851 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-60d1855f-cef6-4bc2-b79c-d6dabe75ca74 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:39.735019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-60d1855f-cef6-4bc2-b79c-d6dabe75ca74 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:39.747134 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60d1855f-cef6-4bc2-b79c-d6dabe75ca74 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:39.749225 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60d1855f-cef6-4bc2-b79c-d6dabe75ca74 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:39.749225 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60d1855f-cef6-4bc2-b79c-d6dabe75ca74 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:39.750128 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60d1855f-cef6-4bc2-b79c-d6dabe75ca74 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:39.751029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60d1855f-cef6-4bc2-b79c-d6dabe75ca74 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:39.751831 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-60d1855f-cef6-4bc2-b79c-d6dabe75ca74 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:39.932051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-60d1855f-cef6-4bc2-b79c-d6dabe75ca74 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:39.943359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-60d1855f-cef6-4bc2-b79c-d6dabe75ca74 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.216720 Aug 29 23:55:39.961901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 297/611] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:39 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:39.976446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-45dd8220-0cd1-476c-8c19-030e6fcee113 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:39.977548 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-45dd8220-0cd1-476c-8c19-030e6fcee113 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:39.989420 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45dd8220-0cd1-476c-8c19-030e6fcee113 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:39.990033 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45dd8220-0cd1-476c-8c19-030e6fcee113 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:39.990675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45dd8220-0cd1-476c-8c19-030e6fcee113 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:39.991699 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45dd8220-0cd1-476c-8c19-030e6fcee113 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:39.992450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45dd8220-0cd1-476c-8c19-030e6fcee113 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:39.993161 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45dd8220-0cd1-476c-8c19-030e6fcee113 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:40.070657 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-45dd8220-0cd1-476c-8c19-030e6fcee113 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:40.085296 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-45dd8220-0cd1-476c-8c19-030e6fcee113 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1294 microversion: 2.1 time: 0.117234 Aug 29 23:55:40.087153 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 315/612] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:39 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:40.968904 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9718dc37-32c1-490b-9597-b6db25ff9e86 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:40.969768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9718dc37-32c1-490b-9597-b6db25ff9e86 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:40.978936 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9718dc37-32c1-490b-9597-b6db25ff9e86 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:40.979673 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9718dc37-32c1-490b-9597-b6db25ff9e86 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:40.980253 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9718dc37-32c1-490b-9597-b6db25ff9e86 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:40.981402 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9718dc37-32c1-490b-9597-b6db25ff9e86 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:40.981911 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9718dc37-32c1-490b-9597-b6db25ff9e86 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:40.982390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9718dc37-32c1-490b-9597-b6db25ff9e86 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:41.110530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-74a498c9-47a3-442e-83b4-f3960afab666 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:41.111516 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-74a498c9-47a3-442e-83b4-f3960afab666 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:41.123774 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74a498c9-47a3-442e-83b4-f3960afab666 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:41.124630 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74a498c9-47a3-442e-83b4-f3960afab666 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:41.125411 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74a498c9-47a3-442e-83b4-f3960afab666 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:41.126776 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74a498c9-47a3-442e-83b4-f3960afab666 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:41.127629 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74a498c9-47a3-442e-83b4-f3960afab666 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:41.129374 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74a498c9-47a3-442e-83b4-f3960afab666 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:41.263091 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-74a498c9-47a3-442e-83b4-f3960afab666 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:41.275929 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-74a498c9-47a3-442e-83b4-f3960afab666 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1300 microversion: 2.1 time: 0.170637 Aug 29 23:55:41.290468 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 316/613] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:41 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1300 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:41.647881 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9718dc37-32c1-490b-9597-b6db25ff9e86 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:41.658484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9718dc37-32c1-490b-9597-b6db25ff9e86 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.695618 Aug 29 23:55:41.659464 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 298/614] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:40 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:42.317492 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d2897c9f-7c45-4b9e-bd4c-d1c512855dd2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:42.318666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d2897c9f-7c45-4b9e-bd4c-d1c512855dd2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:42.328601 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2897c9f-7c45-4b9e-bd4c-d1c512855dd2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:42.329185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2897c9f-7c45-4b9e-bd4c-d1c512855dd2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:42.329693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2897c9f-7c45-4b9e-bd4c-d1c512855dd2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:42.330519 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2897c9f-7c45-4b9e-bd4c-d1c512855dd2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:42.331050 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2897c9f-7c45-4b9e-bd4c-d1c512855dd2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:42.331583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d2897c9f-7c45-4b9e-bd4c-d1c512855dd2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:42.632877 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d2897c9f-7c45-4b9e-bd4c-d1c512855dd2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:42.632877 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d2897c9f-7c45-4b9e-bd4c-d1c512855dd2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1367 microversion: 2.1 time: 0.216468 Aug 29 23:55:42.632877 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 317/615] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:42 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:42.682953 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-91edfe57-89d8-4012-b106-c6258c625d56 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:42.683748 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-91edfe57-89d8-4012-b106-c6258c625d56 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:42.691087 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91edfe57-89d8-4012-b106-c6258c625d56 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:42.691604 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91edfe57-89d8-4012-b106-c6258c625d56 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:42.692165 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91edfe57-89d8-4012-b106-c6258c625d56 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:42.692956 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91edfe57-89d8-4012-b106-c6258c625d56 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:42.693478 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91edfe57-89d8-4012-b106-c6258c625d56 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:42.693910 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91edfe57-89d8-4012-b106-c6258c625d56 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:42.914238 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-91edfe57-89d8-4012-b106-c6258c625d56 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:42.923382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-91edfe57-89d8-4012-b106-c6258c625d56 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.244649 Aug 29 23:55:42.924002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 299/616] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:42 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:43.554235 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9553a312-1dfd-4d26-b3cd-611eebc87d99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:43.555324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9553a312-1dfd-4d26-b3cd-611eebc87d99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:43.567595 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9553a312-1dfd-4d26-b3cd-611eebc87d99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:43.568429 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9553a312-1dfd-4d26-b3cd-611eebc87d99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:43.569127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9553a312-1dfd-4d26-b3cd-611eebc87d99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:43.570346 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9553a312-1dfd-4d26-b3cd-611eebc87d99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:43.571092 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9553a312-1dfd-4d26-b3cd-611eebc87d99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:43.571852 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9553a312-1dfd-4d26-b3cd-611eebc87d99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:43.849587 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9553a312-1dfd-4d26-b3cd-611eebc87d99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:43.857713 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9553a312-1dfd-4d26-b3cd-611eebc87d99 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1367 microversion: 2.1 time: 0.310699 Aug 29 23:55:43.858303 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 318/617] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:43 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:43.946472 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-83767269-3406-4f0d-9ee7-ea05eead8c00 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:43.947125 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-83767269-3406-4f0d-9ee7-ea05eead8c00 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:43.953579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83767269-3406-4f0d-9ee7-ea05eead8c00 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:43.954140 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83767269-3406-4f0d-9ee7-ea05eead8c00 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:43.954614 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83767269-3406-4f0d-9ee7-ea05eead8c00 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:43.955303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83767269-3406-4f0d-9ee7-ea05eead8c00 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:43.955743 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83767269-3406-4f0d-9ee7-ea05eead8c00 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:43.956162 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-83767269-3406-4f0d-9ee7-ea05eead8c00 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:44.210521 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-83767269-3406-4f0d-9ee7-ea05eead8c00 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:44.223238 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-83767269-3406-4f0d-9ee7-ea05eead8c00 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.281619 Aug 29 23:55:44.224117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 300/618] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:43 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:44.387541 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-c8abf2c3-1f0c-4ea6-a5bb-5626408e26c9 req-06dad73f-85ba-410f-a94a-fdd8efa2d0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f0e15f-3470-4cba-a00a-4f282d3ddfd3", "tag": "d541c48e-12a3-458e-89b2-d84241d30d87"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:44.399367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-c8abf2c3-1f0c-4ea6-a5bb-5626408e26c9 req-06dad73f-85ba-410f-a94a-fdd8efa2d0f0 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:44.399804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-c8abf2c3-1f0c-4ea6-a5bb-5626408e26c9 req-06dad73f-85ba-410f-a94a-fdd8efa2d0f0 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:44.400430 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-c8abf2c3-1f0c-4ea6-a5bb-5626408e26c9 req-06dad73f-85ba-410f-a94a-fdd8efa2d0f0 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:44.415054 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-c8abf2c3-1f0c-4ea6-a5bb-5626408e26c9 req-06dad73f-85ba-410f-a94a-fdd8efa2d0f0 service nova] Creating event network-changed:d541c48e-12a3-458e-89b2-d84241d30d87 for instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 on hv-cinder-85427 Aug 29 23:55:44.422619 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-c8abf2c3-1f0c-4ea6-a5bb-5626408e26c9 req-06dad73f-85ba-410f-a94a-fdd8efa2d0f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038508 Aug 29 23:55:44.423914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 319/619] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:44.880071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c604006d-4065-4916-a818-06bc0a3c26bc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:44.881015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c604006d-4065-4916-a818-06bc0a3c26bc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:44.887876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c604006d-4065-4916-a818-06bc0a3c26bc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:44.888359 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c604006d-4065-4916-a818-06bc0a3c26bc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:44.888798 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c604006d-4065-4916-a818-06bc0a3c26bc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:44.889533 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c604006d-4065-4916-a818-06bc0a3c26bc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:44.889997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c604006d-4065-4916-a818-06bc0a3c26bc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:44.890458 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c604006d-4065-4916-a818-06bc0a3c26bc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:45.123277 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c604006d-4065-4916-a818-06bc0a3c26bc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:45.125622 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=100 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:45.134539 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c604006d-4065-4916-a818-06bc0a3c26bc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1367 microversion: 2.1 time: 0.258811 Aug 29 23:55:45.135889 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 301/620] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:44 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:45.249002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7110569c-00d4-4538-a0cc-89ce18d58614 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:45.249723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7110569c-00d4-4538-a0cc-89ce18d58614 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:45.256391 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7110569c-00d4-4538-a0cc-89ce18d58614 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:45.256884 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7110569c-00d4-4538-a0cc-89ce18d58614 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:45.257349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7110569c-00d4-4538-a0cc-89ce18d58614 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:45.258068 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7110569c-00d4-4538-a0cc-89ce18d58614 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:45.258548 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7110569c-00d4-4538-a0cc-89ce18d58614 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:45.258970 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7110569c-00d4-4538-a0cc-89ce18d58614 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:45.453645 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7110569c-00d4-4538-a0cc-89ce18d58614 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:45.462972 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7110569c-00d4-4538-a0cc-89ce18d58614 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.218545 Aug 29 23:55:45.463561 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 320/621] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:45 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:46.162397 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c411b8fb-540b-4f66-ad66-8cef46a37502 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:46.163045 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c411b8fb-540b-4f66-ad66-8cef46a37502 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:46.170216 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c411b8fb-540b-4f66-ad66-8cef46a37502 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:46.170738 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c411b8fb-540b-4f66-ad66-8cef46a37502 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:46.171175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c411b8fb-540b-4f66-ad66-8cef46a37502 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:46.171875 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c411b8fb-540b-4f66-ad66-8cef46a37502 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:46.172319 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c411b8fb-540b-4f66-ad66-8cef46a37502 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:46.172735 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c411b8fb-540b-4f66-ad66-8cef46a37502 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:46.313241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c411b8fb-540b-4f66-ad66-8cef46a37502 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:46.322904 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c411b8fb-540b-4f66-ad66-8cef46a37502 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1367 microversion: 2.1 time: 0.166005 Aug 29 23:55:46.323536 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 302/622] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:46 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:46.489681 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8532532e-d5b1-4c89-8c9d-020a54845fd8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:46.490281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8532532e-d5b1-4c89-8c9d-020a54845fd8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:46.496750 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8532532e-d5b1-4c89-8c9d-020a54845fd8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:46.497224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8532532e-d5b1-4c89-8c9d-020a54845fd8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:46.497645 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8532532e-d5b1-4c89-8c9d-020a54845fd8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:46.498360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8532532e-d5b1-4c89-8c9d-020a54845fd8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:46.499046 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8532532e-d5b1-4c89-8c9d-020a54845fd8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:46.499470 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8532532e-d5b1-4c89-8c9d-020a54845fd8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:46.655309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8532532e-d5b1-4c89-8c9d-020a54845fd8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:46.664391 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8532532e-d5b1-4c89-8c9d-020a54845fd8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.179413 Aug 29 23:55:46.665792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 321/623] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:46 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:47.356533 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-70aae2b4-2bd9-4d09-8704-68f52fa0e642 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:47.360273 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-70aae2b4-2bd9-4d09-8704-68f52fa0e642 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:47.363919 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70aae2b4-2bd9-4d09-8704-68f52fa0e642 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:47.364493 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70aae2b4-2bd9-4d09-8704-68f52fa0e642 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:47.365106 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70aae2b4-2bd9-4d09-8704-68f52fa0e642 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:47.365930 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70aae2b4-2bd9-4d09-8704-68f52fa0e642 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:47.366388 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70aae2b4-2bd9-4d09-8704-68f52fa0e642 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:47.366840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70aae2b4-2bd9-4d09-8704-68f52fa0e642 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:47.509375 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-70aae2b4-2bd9-4d09-8704-68f52fa0e642 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:47.517340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-70aae2b4-2bd9-4d09-8704-68f52fa0e642 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1367 microversion: 2.1 time: 0.165115 Aug 29 23:55:47.517904 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 303/624] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:47 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:47.686894 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-915ec42d-30e8-4156-9a94-4b8fbc2e912f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:47.687661 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-915ec42d-30e8-4156-9a94-4b8fbc2e912f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:47.695167 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-915ec42d-30e8-4156-9a94-4b8fbc2e912f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:47.695650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-915ec42d-30e8-4156-9a94-4b8fbc2e912f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:47.696077 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-915ec42d-30e8-4156-9a94-4b8fbc2e912f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:47.696769 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-915ec42d-30e8-4156-9a94-4b8fbc2e912f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:47.697275 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-915ec42d-30e8-4156-9a94-4b8fbc2e912f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:47.697690 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-915ec42d-30e8-4156-9a94-4b8fbc2e912f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:47.815424 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=6 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:47.853983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-915ec42d-30e8-4156-9a94-4b8fbc2e912f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:47.863000 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-915ec42d-30e8-4156-9a94-4b8fbc2e912f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.180600 Aug 29 23:55:47.863586 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 322/625] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:47 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:48.539857 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-43e74cf7-6776-4fe7-aa5c-6bef3e1d5c24 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:48.540457 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-43e74cf7-6776-4fe7-aa5c-6bef3e1d5c24 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:48.542887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:48.543815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=6 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:48.553880 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-43e74cf7-6776-4fe7-aa5c-6bef3e1d5c24 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:48.564657 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-43e74cf7-6776-4fe7-aa5c-6bef3e1d5c24 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:48.564657 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-43e74cf7-6776-4fe7-aa5c-6bef3e1d5c24 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:48.564657 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-43e74cf7-6776-4fe7-aa5c-6bef3e1d5c24 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:48.564657 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-43e74cf7-6776-4fe7-aa5c-6bef3e1d5c24 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:48.565095 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-43e74cf7-6776-4fe7-aa5c-6bef3e1d5c24 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:48.678352 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7577f5ef-8891-4920-9738-ca77d4cc23f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:48.680692 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7577f5ef-8891-4920-9738-ca77d4cc23f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:48.686858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7577f5ef-8891-4920-9738-ca77d4cc23f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:48.690734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7577f5ef-8891-4920-9738-ca77d4cc23f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:48.690734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7577f5ef-8891-4920-9738-ca77d4cc23f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:48.690734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7577f5ef-8891-4920-9738-ca77d4cc23f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:48.690734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7577f5ef-8891-4920-9738-ca77d4cc23f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:48.691623 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7577f5ef-8891-4920-9738-ca77d4cc23f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:48.707531 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-43e74cf7-6776-4fe7-aa5c-6bef3e1d5c24 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:48.711517 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:48.722409 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-43e74cf7-6776-4fe7-aa5c-6bef3e1d5c24 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1367 microversion: 2.1 time: 0.186795 Aug 29 23:55:48.724385 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 304/626] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:48 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:48.726397 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7577f5ef-8891-4920-9738-ca77d4cc23f8 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052557 Aug 29 23:55:48.726982 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 323/627] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:55:48 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 23:55:48.795431 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-edff0be7-dbfc-424f-9aa5-54b9c1c54bb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:48.796290 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-edff0be7-dbfc-424f-9aa5-54b9c1c54bb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:48.803144 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-edff0be7-dbfc-424f-9aa5-54b9c1c54bb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:48.803912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-edff0be7-dbfc-424f-9aa5-54b9c1c54bb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:48.804486 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-edff0be7-dbfc-424f-9aa5-54b9c1c54bb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:48.805265 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-edff0be7-dbfc-424f-9aa5-54b9c1c54bb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:48.805828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-edff0be7-dbfc-424f-9aa5-54b9c1c54bb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:48.806474 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-edff0be7-dbfc-424f-9aa5-54b9c1c54bb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:48.834238 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-edff0be7-dbfc-424f-9aa5-54b9c1c54bb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Going to try to terminate instance {{(pid=127706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:55:48.884253 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-05e0f7c1-0ef0-4112-b5b7-2bb0e2bb9784 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:48.884866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-05e0f7c1-0ef0-4112-b5b7-2bb0e2bb9784 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:48.890928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05e0f7c1-0ef0-4112-b5b7-2bb0e2bb9784 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:48.891508 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05e0f7c1-0ef0-4112-b5b7-2bb0e2bb9784 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:48.896095 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05e0f7c1-0ef0-4112-b5b7-2bb0e2bb9784 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:48.896095 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05e0f7c1-0ef0-4112-b5b7-2bb0e2bb9784 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:48.896095 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05e0f7c1-0ef0-4112-b5b7-2bb0e2bb9784 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:48.896095 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-05e0f7c1-0ef0-4112-b5b7-2bb0e2bb9784 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:49.041706 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-05e0f7c1-0ef0-4112-b5b7-2bb0e2bb9784 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:49.051224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-05e0f7c1-0ef0-4112-b5b7-2bb0e2bb9784 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1756 microversion: 2.1 time: 0.171090 Aug 29 23:55:49.052103 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 324/628] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:48 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:49.215274 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-edff0be7-dbfc-424f-9aa5-54b9c1c54bb2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 204 len: 0 microversion: 2.1 time: 0.423290 Aug 29 23:55:49.215973 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 305/629] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:55:48 2022] DELETE /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:55:49.224787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2c379b59-f0ff-4c39-b026-d43c2544ab3b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:49.225337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2c379b59-f0ff-4c39-b026-d43c2544ab3b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:49.232115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c379b59-f0ff-4c39-b026-d43c2544ab3b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:49.232609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c379b59-f0ff-4c39-b026-d43c2544ab3b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:49.233043 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c379b59-f0ff-4c39-b026-d43c2544ab3b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:49.233742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c379b59-f0ff-4c39-b026-d43c2544ab3b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:49.234194 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c379b59-f0ff-4c39-b026-d43c2544ab3b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:49.234661 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c379b59-f0ff-4c39-b026-d43c2544ab3b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:49.390144 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2c379b59-f0ff-4c39-b026-d43c2544ab3b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:49.398701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2c379b59-f0ff-4c39-b026-d43c2544ab3b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1674 microversion: 2.1 time: 0.178261 Aug 29 23:55:49.399268 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 325/630] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:49 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:49.747147 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d1f70a90-3dd4-4ca5-95ea-b8da02fcdafa tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:49.747879 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d1f70a90-3dd4-4ca5-95ea-b8da02fcdafa tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:49.754636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1f70a90-3dd4-4ca5-95ea-b8da02fcdafa tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:49.756054 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1f70a90-3dd4-4ca5-95ea-b8da02fcdafa tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:49.756162 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1f70a90-3dd4-4ca5-95ea-b8da02fcdafa tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:49.756829 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1f70a90-3dd4-4ca5-95ea-b8da02fcdafa tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:49.757286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1f70a90-3dd4-4ca5-95ea-b8da02fcdafa tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:49.757715 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d1f70a90-3dd4-4ca5-95ea-b8da02fcdafa tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:49.915096 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d1f70a90-3dd4-4ca5-95ea-b8da02fcdafa tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:49.920270 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d1f70a90-3dd4-4ca5-95ea-b8da02fcdafa tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1367 microversion: 2.1 time: 0.177381 Aug 29 23:55:49.920862 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 306/631] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:49 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:50.074895 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5f16808d-e3a6-44d2-a0c7-655abd879cbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:50.075787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-5f16808d-e3a6-44d2-a0c7-655abd879cbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:50.084097 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f16808d-e3a6-44d2-a0c7-655abd879cbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:50.085028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f16808d-e3a6-44d2-a0c7-655abd879cbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:50.085580 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f16808d-e3a6-44d2-a0c7-655abd879cbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:50.086502 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f16808d-e3a6-44d2-a0c7-655abd879cbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:50.087155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f16808d-e3a6-44d2-a0c7-655abd879cbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:50.087501 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f16808d-e3a6-44d2-a0c7-655abd879cbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:50.258304 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5f16808d-e3a6-44d2-a0c7-655abd879cbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:50.266590 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5f16808d-e3a6-44d2-a0c7-655abd879cbc tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1759 microversion: 2.1 time: 0.196499 Aug 29 23:55:50.267217 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 326/632] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:50 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1759 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:50.419345 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-40a7430e-9ca0-4688-97cd-f2ffd14c1da0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:50.419968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-40a7430e-9ca0-4688-97cd-f2ffd14c1da0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:50.425799 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40a7430e-9ca0-4688-97cd-f2ffd14c1da0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:50.426284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40a7430e-9ca0-4688-97cd-f2ffd14c1da0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:50.426767 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40a7430e-9ca0-4688-97cd-f2ffd14c1da0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:50.427460 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40a7430e-9ca0-4688-97cd-f2ffd14c1da0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:50.427910 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40a7430e-9ca0-4688-97cd-f2ffd14c1da0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:50.428396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40a7430e-9ca0-4688-97cd-f2ffd14c1da0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:50.617800 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-16296aeb-7931-49d4-b0cb-ae4bc1eaf563 req-e0bac670-329f-4a1e-90df-9afa25e48991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f0e15f-3470-4cba-a00a-4f282d3ddfd3", "name": "network-vif-plugged", "status": "completed", "tag": "d541c48e-12a3-458e-89b2-d84241d30d87"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:50.625227 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-40a7430e-9ca0-4688-97cd-f2ffd14c1da0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:50.627983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-16296aeb-7931-49d4-b0cb-ae4bc1eaf563 req-e0bac670-329f-4a1e-90df-9afa25e48991 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:50.628461 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-16296aeb-7931-49d4-b0cb-ae4bc1eaf563 req-e0bac670-329f-4a1e-90df-9afa25e48991 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:50.628906 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-16296aeb-7931-49d4-b0cb-ae4bc1eaf563 req-e0bac670-329f-4a1e-90df-9afa25e48991 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:50.634608 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-40a7430e-9ca0-4688-97cd-f2ffd14c1da0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1674 microversion: 2.1 time: 0.219017 Aug 29 23:55:50.635193 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 307/633] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:50 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:50.642044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-16296aeb-7931-49d4-b0cb-ae4bc1eaf563 req-e0bac670-329f-4a1e-90df-9afa25e48991 service nova] Creating event network-vif-plugged:d541c48e-12a3-458e-89b2-d84241d30d87 for instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 on hv-cinder-85427 Aug 29 23:55:50.649005 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-16296aeb-7931-49d4-b0cb-ae4bc1eaf563 req-e0bac670-329f-4a1e-90df-9afa25e48991 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039607 Aug 29 23:55:50.649773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 327/634] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:50.946846 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f5fc3698-a5e4-47ef-993b-6b768256c427 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:50.947457 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f5fc3698-a5e4-47ef-993b-6b768256c427 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:50.953578 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5fc3698-a5e4-47ef-993b-6b768256c427 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:50.954046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5fc3698-a5e4-47ef-993b-6b768256c427 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:50.958284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5fc3698-a5e4-47ef-993b-6b768256c427 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:50.958284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5fc3698-a5e4-47ef-993b-6b768256c427 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:50.958284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5fc3698-a5e4-47ef-993b-6b768256c427 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:50.958284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f5fc3698-a5e4-47ef-993b-6b768256c427 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:51.111274 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f5fc3698-a5e4-47ef-993b-6b768256c427 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:51.121131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f5fc3698-a5e4-47ef-993b-6b768256c427 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1367 microversion: 2.1 time: 0.183519 Aug 29 23:55:51.121632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 308/635] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:50 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:51.658320 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3db2f641-fa97-4c37-949c-328df984a43d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:51.658967 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3db2f641-fa97-4c37-949c-328df984a43d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:51.665933 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db2f641-fa97-4c37-949c-328df984a43d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:51.666438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db2f641-fa97-4c37-949c-328df984a43d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:51.669068 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db2f641-fa97-4c37-949c-328df984a43d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:51.669068 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db2f641-fa97-4c37-949c-328df984a43d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:51.669068 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db2f641-fa97-4c37-949c-328df984a43d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:51.669068 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db2f641-fa97-4c37-949c-328df984a43d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:51.923313 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3db2f641-fa97-4c37-949c-328df984a43d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:51.932391 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3db2f641-fa97-4c37-949c-328df984a43d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1674 microversion: 2.1 time: 0.278769 Aug 29 23:55:51.933207 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 328/636] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:51 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1674 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:52.143508 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-692045c9-e950-4f73-bd84-55d5cfc28ccc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:52.144360 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-692045c9-e950-4f73-bd84-55d5cfc28ccc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:52.152779 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-692045c9-e950-4f73-bd84-55d5cfc28ccc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:52.153279 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-692045c9-e950-4f73-bd84-55d5cfc28ccc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:52.153715 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-692045c9-e950-4f73-bd84-55d5cfc28ccc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:52.154549 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-692045c9-e950-4f73-bd84-55d5cfc28ccc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:52.155016 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-692045c9-e950-4f73-bd84-55d5cfc28ccc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:52.155440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-692045c9-e950-4f73-bd84-55d5cfc28ccc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:52.428490 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-692045c9-e950-4f73-bd84-55d5cfc28ccc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:52.436788 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-692045c9-e950-4f73-bd84-55d5cfc28ccc tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1367 microversion: 2.1 time: 0.297242 Aug 29 23:55:52.437530 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 309/637] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:52 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:52.921166 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-2084c8a1-0e4a-47d4-9303-ff80a88f69e3 req-40aca854-0e15-4a6b-9936-f698ee6c647f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a", "name": "network-vif-deleted", "tag": "f1ec22c6-261a-4c67-84d2-31f8a47e0693"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:52.940819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2084c8a1-0e4a-47d4-9303-ff80a88f69e3 req-40aca854-0e15-4a6b-9936-f698ee6c647f service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:52.941724 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2084c8a1-0e4a-47d4-9303-ff80a88f69e3 req-40aca854-0e15-4a6b-9936-f698ee6c647f service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:52.943112 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2084c8a1-0e4a-47d4-9303-ff80a88f69e3 req-40aca854-0e15-4a6b-9936-f698ee6c647f service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:52.955615 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-091f4ed3-27a6-45c9-aca6-7698a246962b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:52.956890 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-091f4ed3-27a6-45c9-aca6-7698a246962b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:52.962293 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-2084c8a1-0e4a-47d4-9303-ff80a88f69e3 req-40aca854-0e15-4a6b-9936-f698ee6c647f service nova] Creating event network-vif-deleted:f1ec22c6-261a-4c67-84d2-31f8a47e0693 for instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a on hv-cinder-85427 Aug 29 23:55:52.965626 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-091f4ed3-27a6-45c9-aca6-7698a246962b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:52.966495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-091f4ed3-27a6-45c9-aca6-7698a246962b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:52.967184 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-091f4ed3-27a6-45c9-aca6-7698a246962b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:52.968016 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-091f4ed3-27a6-45c9-aca6-7698a246962b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:52.968493 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-2084c8a1-0e4a-47d4-9303-ff80a88f69e3 req-40aca854-0e15-4a6b-9936-f698ee6c647f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053685 Aug 29 23:55:52.968800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-091f4ed3-27a6-45c9-aca6-7698a246962b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:52.969394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-091f4ed3-27a6-45c9-aca6-7698a246962b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:52.969792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 329/638] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:53.047855 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-091f4ed3-27a6-45c9-aca6-7698a246962b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:53.058827 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-091f4ed3-27a6-45c9-aca6-7698a246962b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1607 microversion: 2.1 time: 0.107306 Aug 29 23:55:53.059668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 310/639] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:52 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1607 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:55:53.461752 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e3e00133-46d4-4e6e-894d-da1d4524f4c5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:53.462488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e3e00133-46d4-4e6e-894d-da1d4524f4c5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:53.469408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e3e00133-46d4-4e6e-894d-da1d4524f4c5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:53.469960 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e3e00133-46d4-4e6e-894d-da1d4524f4c5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:53.470400 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e3e00133-46d4-4e6e-894d-da1d4524f4c5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:53.471155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e3e00133-46d4-4e6e-894d-da1d4524f4c5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:53.471602 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e3e00133-46d4-4e6e-894d-da1d4524f4c5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:53.472024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e3e00133-46d4-4e6e-894d-da1d4524f4c5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:53.617164 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e3e00133-46d4-4e6e-894d-da1d4524f4c5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:53.625409 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e3e00133-46d4-4e6e-894d-da1d4524f4c5 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1367 microversion: 2.1 time: 0.168936 Aug 29 23:55:53.626392 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 330/640] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:53 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:54.083544 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:54.084821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:54.092570 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:54.093536 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:54.094396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.095624 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:54.096185 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:54.097010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.134668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:54.135069 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:54.135616 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.136240 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lazy-loading 'fault' on Instance uuid 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:55:54.183440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:54.194098 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a642a8e6-c6eb-4b30-a58f-c1c33aea197c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 200 len: 1328 microversion: 2.1 time: 0.116309 Aug 29 23:55:54.194750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 311/641] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:54 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:54.647223 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9b920572-598d-4e03-a265-0f932ddbb1ac tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:54.648388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9b920572-598d-4e03-a265-0f932ddbb1ac tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:54.660156 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9b920572-598d-4e03-a265-0f932ddbb1ac tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:54.661392 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9b920572-598d-4e03-a265-0f932ddbb1ac tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:54.662200 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9b920572-598d-4e03-a265-0f932ddbb1ac tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.663579 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9b920572-598d-4e03-a265-0f932ddbb1ac tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:54.664429 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9b920572-598d-4e03-a265-0f932ddbb1ac tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:54.665199 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9b920572-598d-4e03-a265-0f932ddbb1ac tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.852183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9b920572-598d-4e03-a265-0f932ddbb1ac tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:54.860710 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9b920572-598d-4e03-a265-0f932ddbb1ac tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1556 microversion: 2.1 time: 0.218130 Aug 29 23:55:54.861385 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 331/642] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:54 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:55:54.882415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1d5d31f1-e114-46ba-a4a3-a5fb9e723481 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:54.882942 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1d5d31f1-e114-46ba-a4a3-a5fb9e723481 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:54.889053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d5d31f1-e114-46ba-a4a3-a5fb9e723481 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:54.889544 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d5d31f1-e114-46ba-a4a3-a5fb9e723481 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:54.889982 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d5d31f1-e114-46ba-a4a3-a5fb9e723481 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.890720 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d5d31f1-e114-46ba-a4a3-a5fb9e723481 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:54.891173 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d5d31f1-e114-46ba-a4a3-a5fb9e723481 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:54.891596 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1d5d31f1-e114-46ba-a4a3-a5fb9e723481 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:54.971195 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1d5d31f1-e114-46ba-a4a3-a5fb9e723481 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092692 Aug 29 23:55:54.971793 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 312/643] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Aug 29 23:55:54 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:55.227463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:55.228475 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:55.235325 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:55.235851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:55.236292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:55.237073 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:55.237532 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:55.237956 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:55.253999 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] HTTP exception thrown: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Request method failure captured: Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a HTTP/1.1 Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVDv_g7TBwcydF81qdvi-pt5eLIM0ZAsa22eVJvwXJ243_TxskKKUmG7Eg6hTMAKBT7ma_9G8GsBje35KliHD55VokENYpXLkPRu3qHm3c9suS2Isi3CcYkZaGdQoqopf5zSmmDWp6nPsYQnmJX6SfwdkfrF3wDrvmYfFwAB2AqnlhY Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:55:55.255885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2d358f3073d446f49dc51777a7afc30e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: db604b7af623452fac9b3712b6978168 Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:55:55.257574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a'} Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:55:55.258349 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:55:55.259614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:55:55.260714 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Returning 404 to user: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:55:55.260714 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e1519a69-5cdf-4d7e-a960-cef524c7cb10 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 404 len: 111 microversion: 2.1 time: 0.035931 Aug 29 23:55:55.260714 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 332/644] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:55 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:55:55.267846 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3bcaed64-4faa-4763-8a8b-ec5a3a90588b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '.version_select at 0x7fabbdcc38b0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:55.370513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3bcaed64-4faa-4763-8a8b-ec5a3a90588b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273257739" status: 202 len: 0 microversion: 2.1 time: 0.106890 Aug 29 23:55:55.371467 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 313/645] 10.222.0.58 () {58 vars in 1221 bytes} [Mon Aug 29 23:55:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273257739 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:55:56.539893 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c6723693-51d2-4929-b9bc-a0cd6597ddc0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'create', calling method: .version_select at 0x7fabbdd3d280>, body: {"keypair": {"name": "tempest-keypair-2009252561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqiq2AyKDA61/LIImqAVIcJAt0TBnsZbk7muQby+Ky+h3/S+HM+eh5tQksxxtFZ+vdU4j8XMXhM6cVmXaF4cjUOblq/5MzqKSHB0mN+Wov9bKKXl8Tku1TpnwbtWgue9g=="}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:56.557824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-c6723693-51d2-4929-b9bc-a0cd6597ddc0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Getting quotas for project 2d358f3073d446f49dc51777a7afc30e. Resources: {'key_pairs'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:55:56.562324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-c6723693-51d2-4929-b9bc-a0cd6597ddc0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Getting quotas for user db604b7af623452fac9b3712b6978168 and project 2d358f3073d446f49dc51777a7afc30e. Resources: {'key_pairs'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:55:56.654303 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c6723693-51d2-4929-b9bc-a0cd6597ddc0 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119092 Aug 29 23:55:56.654943 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 333/646] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Aug 29 23:55:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:55:56.688643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-904c0ae6-978f-4c4c-8ca6-b946c35934de req-96bf46f6-7fea-4186-94dc-97794c9f182e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f0e15f-3470-4cba-a00a-4f282d3ddfd3", "tag": "d541c48e-12a3-458e-89b2-d84241d30d87"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:56.701254 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-904c0ae6-978f-4c4c-8ca6-b946c35934de req-96bf46f6-7fea-4186-94dc-97794c9f182e service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:56.701835 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-904c0ae6-978f-4c4c-8ca6-b946c35934de req-96bf46f6-7fea-4186-94dc-97794c9f182e service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:56.702337 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-904c0ae6-978f-4c4c-8ca6-b946c35934de req-96bf46f6-7fea-4186-94dc-97794c9f182e service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:56.713865 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-904c0ae6-978f-4c4c-8ca6-b946c35934de req-96bf46f6-7fea-4186-94dc-97794c9f182e service nova] Creating event network-changed:d541c48e-12a3-458e-89b2-d84241d30d87 for instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 on hv-cinder-85427 Aug 29 23:55:56.719410 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-904c0ae6-978f-4c4c-8ca6-b946c35934de req-96bf46f6-7fea-4186-94dc-97794c9f182e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035568 Aug 29 23:55:56.720305 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 314/647] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:55:58.988392 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-336778667", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81309772-a7ea-411c-9807-d5770abcbfb5"}], "security_groups": [{"name": "tempest-securitygroup--1960877919"}], "key_name": "tempest-keypair-2009252561", "user_data": "}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:55:59.099967 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] validate_networks() for [('81309772-a7ea-411c-9807-d5770abcbfb5', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:55:59.498858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:55:59.499288 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:55:59.499758 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:55:59.500193 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:55:59.500583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:55:59.513755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:59.514249 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:59.514728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:59.515471 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:55:59.515968 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:55:59.516392 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:55:59.534973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Getting quotas for project 2d358f3073d446f49dc51777a7afc30e. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:55:59.540453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Getting quotas for user db604b7af623452fac9b3712b6978168 and project 2d358f3073d446f49dc51777a7afc30e. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:55:59.553268 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:55:59.555641 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:55:59.702226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6e0a08c0-6bb6-40da-8c4e-45c9d08b5a06 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.718070 Aug 29 23:55:59.703236 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 334/648] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:55:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:55:59.716735 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-618ff5a9-197a-46a4-82c4-9fbe56691661 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:55:59.717525 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-618ff5a9-197a-46a4-82c4-9fbe56691661 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:55:59.774556 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-618ff5a9-197a-46a4-82c4-9fbe56691661 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:55:59.782001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-618ff5a9-197a-46a4-82c4-9fbe56691661 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1237 microversion: 2.1 time: 0.070928 Aug 29 23:55:59.782601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 315/649] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:55:59 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:00.804734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d875a8cf-38c6-4738-a120-e43a2fdab73b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:00.805363 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d875a8cf-38c6-4738-a120-e43a2fdab73b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:00.811691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d875a8cf-38c6-4738-a120-e43a2fdab73b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:00.812174 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d875a8cf-38c6-4738-a120-e43a2fdab73b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:00.812603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d875a8cf-38c6-4738-a120-e43a2fdab73b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:00.813301 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d875a8cf-38c6-4738-a120-e43a2fdab73b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:00.813837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d875a8cf-38c6-4738-a120-e43a2fdab73b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:00.814258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d875a8cf-38c6-4738-a120-e43a2fdab73b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:00.885463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d875a8cf-38c6-4738-a120-e43a2fdab73b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:00.894171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d875a8cf-38c6-4738-a120-e43a2fdab73b tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1241 microversion: 2.1 time: 0.093835 Aug 29 23:56:00.894776 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 335/650] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:00 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:01.915999 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-91633faf-bc9b-4ee0-88a2-0ac15d97bfaa tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:01.916660 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-91633faf-bc9b-4ee0-88a2-0ac15d97bfaa tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:01.923862 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91633faf-bc9b-4ee0-88a2-0ac15d97bfaa tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:01.924352 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91633faf-bc9b-4ee0-88a2-0ac15d97bfaa tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:01.924795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91633faf-bc9b-4ee0-88a2-0ac15d97bfaa tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:01.925515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91633faf-bc9b-4ee0-88a2-0ac15d97bfaa tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:01.925993 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91633faf-bc9b-4ee0-88a2-0ac15d97bfaa tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:01.926404 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91633faf-bc9b-4ee0-88a2-0ac15d97bfaa tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:01.996733 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-91633faf-bc9b-4ee0-88a2-0ac15d97bfaa tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:02.005051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-91633faf-bc9b-4ee0-88a2-0ac15d97bfaa tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1289 microversion: 2.1 time: 0.092576 Aug 29 23:56:02.005681 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 316/651] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:01 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:03.027086 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-77cff8a2-93bb-42fb-8dd2-472bec8a0548 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:03.027771 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-77cff8a2-93bb-42fb-8dd2-472bec8a0548 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:03.030254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:03.035110 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77cff8a2-93bb-42fb-8dd2-472bec8a0548 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:03.035603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77cff8a2-93bb-42fb-8dd2-472bec8a0548 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:03.036711 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77cff8a2-93bb-42fb-8dd2-472bec8a0548 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:03.037734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77cff8a2-93bb-42fb-8dd2-472bec8a0548 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:03.038190 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77cff8a2-93bb-42fb-8dd2-472bec8a0548 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:03.038649 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77cff8a2-93bb-42fb-8dd2-472bec8a0548 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:03.397858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-77cff8a2-93bb-42fb-8dd2-472bec8a0548 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:03.409506 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-77cff8a2-93bb-42fb-8dd2-472bec8a0548 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.385907 Aug 29 23:56:03.423257 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 336/652] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:03 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:04.336137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-824dffa7-aaf6-40bf-abf2-a5d51a9d9c60 req-baaa8fed-8738-4c85-bff9-bac4e205acc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcf4e47-8d33-4c78-a889-876e9f941757", "tag": "9aab1db7-2f82-4fbf-b6c0-7f1a581d7326"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:04.352584 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-824dffa7-aaf6-40bf-abf2-a5d51a9d9c60 req-baaa8fed-8738-4c85-bff9-bac4e205acc5 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:04.353862 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-824dffa7-aaf6-40bf-abf2-a5d51a9d9c60 req-baaa8fed-8738-4c85-bff9-bac4e205acc5 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:04.355087 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-824dffa7-aaf6-40bf-abf2-a5d51a9d9c60 req-baaa8fed-8738-4c85-bff9-bac4e205acc5 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:04.370340 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-824dffa7-aaf6-40bf-abf2-a5d51a9d9c60 req-baaa8fed-8738-4c85-bff9-bac4e205acc5 service nova] Creating event network-changed:9aab1db7-2f82-4fbf-b6c0-7f1a581d7326 for instance 9fcf4e47-8d33-4c78-a889-876e9f941757 on hv-cinder-85427 Aug 29 23:56:04.375470 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-824dffa7-aaf6-40bf-abf2-a5d51a9d9c60 req-baaa8fed-8738-4c85-bff9-bac4e205acc5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043515 Aug 29 23:56:04.376253 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 317/653] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:04.445977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-365535d9-5b6b-406a-a3ab-6e97bebe7717 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:04.446793 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-365535d9-5b6b-406a-a3ab-6e97bebe7717 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:04.454817 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-365535d9-5b6b-406a-a3ab-6e97bebe7717 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:04.455480 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-365535d9-5b6b-406a-a3ab-6e97bebe7717 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:04.455929 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-365535d9-5b6b-406a-a3ab-6e97bebe7717 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:04.456640 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-365535d9-5b6b-406a-a3ab-6e97bebe7717 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:04.457103 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-365535d9-5b6b-406a-a3ab-6e97bebe7717 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:04.457524 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-365535d9-5b6b-406a-a3ab-6e97bebe7717 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:04.695423 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-365535d9-5b6b-406a-a3ab-6e97bebe7717 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:04.703801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-365535d9-5b6b-406a-a3ab-6e97bebe7717 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.263719 Aug 29 23:56:04.704463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 337/654] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:04 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:05.736781 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-686cce49-acbf-4d16-8a71-cc6d55b891f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:05.737363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-686cce49-acbf-4d16-8a71-cc6d55b891f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:05.744294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-686cce49-acbf-4d16-8a71-cc6d55b891f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:05.744776 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-686cce49-acbf-4d16-8a71-cc6d55b891f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:05.745226 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-686cce49-acbf-4d16-8a71-cc6d55b891f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:05.745901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-686cce49-acbf-4d16-8a71-cc6d55b891f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:05.746348 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-686cce49-acbf-4d16-8a71-cc6d55b891f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:05.746798 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-686cce49-acbf-4d16-8a71-cc6d55b891f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:05.947501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-686cce49-acbf-4d16-8a71-cc6d55b891f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:05.955627 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-686cce49-acbf-4d16-8a71-cc6d55b891f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.223752 Aug 29 23:56:05.956193 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 318/655] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:05 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:06.978232 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4bb6c0bd-7f95-4e74-8b2b-b5cd8ccae8ae tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:06.978878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4bb6c0bd-7f95-4e74-8b2b-b5cd8ccae8ae tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:06.985371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bb6c0bd-7f95-4e74-8b2b-b5cd8ccae8ae tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:06.985855 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bb6c0bd-7f95-4e74-8b2b-b5cd8ccae8ae tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:06.986280 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bb6c0bd-7f95-4e74-8b2b-b5cd8ccae8ae tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:06.987012 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bb6c0bd-7f95-4e74-8b2b-b5cd8ccae8ae tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:06.987456 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bb6c0bd-7f95-4e74-8b2b-b5cd8ccae8ae tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:06.987873 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4bb6c0bd-7f95-4e74-8b2b-b5cd8ccae8ae tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:07.168456 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4bb6c0bd-7f95-4e74-8b2b-b5cd8ccae8ae tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:07.177603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4bb6c0bd-7f95-4e74-8b2b-b5cd8ccae8ae tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.203754 Aug 29 23:56:07.178181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 338/656] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:06 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:08.031090 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-44907186-ce9a-40b1-9809-da6637a90dd8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:08.031710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-44907186-ce9a-40b1-9809-da6637a90dd8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:08.034118 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:08.039203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-44907186-ce9a-40b1-9809-da6637a90dd8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:08.047329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-44907186-ce9a-40b1-9809-da6637a90dd8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:08.047329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-44907186-ce9a-40b1-9809-da6637a90dd8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:08.047329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-44907186-ce9a-40b1-9809-da6637a90dd8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:08.047329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-44907186-ce9a-40b1-9809-da6637a90dd8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:08.047737 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-44907186-ce9a-40b1-9809-da6637a90dd8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:08.132774 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-44907186-ce9a-40b1-9809-da6637a90dd8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lazy-loading 'services' on Instance uuid 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:08.167038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:08.204091 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6bf29245-cb84-4257-9068-1021866cedd1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:08.204742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6bf29245-cb84-4257-9068-1021866cedd1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:08.211874 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bf29245-cb84-4257-9068-1021866cedd1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:08.212657 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bf29245-cb84-4257-9068-1021866cedd1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:08.212794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bf29245-cb84-4257-9068-1021866cedd1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:08.213483 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bf29245-cb84-4257-9068-1021866cedd1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:08.213930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bf29245-cb84-4257-9068-1021866cedd1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:08.214338 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bf29245-cb84-4257-9068-1021866cedd1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:08.360225 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6bf29245-cb84-4257-9068-1021866cedd1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:08.368586 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6bf29245-cb84-4257-9068-1021866cedd1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.170597 Aug 29 23:56:08.369162 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 339/657] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:08 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:08.372981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-44907186-ce9a-40b1-9809-da6637a90dd8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments/7dd8f320-dd8f-4a2c-bbf6-bbd70147e16e" status: 202 len: 0 microversion: 2.1 time: 0.346059 Aug 29 23:56:08.373610 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 319/658] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Aug 29 23:56:08 2022] DELETE /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments/7dd8f320-dd8f-4a2c-bbf6-bbd70147e16e => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:56:08.382585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6bcae252-9aee-47a9-a515-2f28f1f70d90 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:08.386238 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6bcae252-9aee-47a9-a515-2f28f1f70d90 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:08.392823 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bcae252-9aee-47a9-a515-2f28f1f70d90 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:08.393327 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bcae252-9aee-47a9-a515-2f28f1f70d90 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:08.393775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bcae252-9aee-47a9-a515-2f28f1f70d90 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:08.394649 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bcae252-9aee-47a9-a515-2f28f1f70d90 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:08.395113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bcae252-9aee-47a9-a515-2f28f1f70d90 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:08.395540 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6bcae252-9aee-47a9-a515-2f28f1f70d90 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:08.430464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6bcae252-9aee-47a9-a515-2f28f1f70d90 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052151 Aug 29 23:56:08.431609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 340/659] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:08 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:09.391078 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-051f9250-0716-4e86-b31a-e14f09073d1d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:09.391773 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-051f9250-0716-4e86-b31a-e14f09073d1d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:09.400581 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-051f9250-0716-4e86-b31a-e14f09073d1d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:09.401076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-051f9250-0716-4e86-b31a-e14f09073d1d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:09.401556 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-051f9250-0716-4e86-b31a-e14f09073d1d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:09.402266 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-051f9250-0716-4e86-b31a-e14f09073d1d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:09.402980 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-051f9250-0716-4e86-b31a-e14f09073d1d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:09.403569 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-051f9250-0716-4e86-b31a-e14f09073d1d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:09.443533 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-abeb6606-e5d5-489a-a715-2446de1efbc8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:09.445765 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-abeb6606-e5d5-489a-a715-2446de1efbc8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:09.452380 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-abeb6606-e5d5-489a-a715-2446de1efbc8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:09.452857 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-abeb6606-e5d5-489a-a715-2446de1efbc8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:09.453295 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-abeb6606-e5d5-489a-a715-2446de1efbc8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:09.454002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-abeb6606-e5d5-489a-a715-2446de1efbc8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:09.454478 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-abeb6606-e5d5-489a-a715-2446de1efbc8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:09.454905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-abeb6606-e5d5-489a-a715-2446de1efbc8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:09.488570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-abeb6606-e5d5-489a-a715-2446de1efbc8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048779 Aug 29 23:56:09.489113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 341/660] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:09 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:09.556351 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-051f9250-0716-4e86-b31a-e14f09073d1d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:09.564537 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-051f9250-0716-4e86-b31a-e14f09073d1d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.178221 Aug 29 23:56:09.565117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 320/661] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:09 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:10.501513 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8a3e7d23-fd41-414c-8219-f8cbf8029793 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:10.503684 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8a3e7d23-fd41-414c-8219-f8cbf8029793 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:10.505522 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:10.506187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=10 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:10.511915 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a3e7d23-fd41-414c-8219-f8cbf8029793 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.512405 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a3e7d23-fd41-414c-8219-f8cbf8029793 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.512851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a3e7d23-fd41-414c-8219-f8cbf8029793 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.513543 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a3e7d23-fd41-414c-8219-f8cbf8029793 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.514000 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a3e7d23-fd41-414c-8219-f8cbf8029793 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.514443 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a3e7d23-fd41-414c-8219-f8cbf8029793 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.544348 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8a3e7d23-fd41-414c-8219-f8cbf8029793 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046824 Aug 29 23:56:10.544847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 342/662] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:10 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:56:10.593427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-27ed842d-98d8-4903-811f-6d19613a42b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:10.594258 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-27ed842d-98d8-4903-811f-6d19613a42b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:10.596512 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:10.602923 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ed842d-98d8-4903-811f-6d19613a42b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.603421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ed842d-98d8-4903-811f-6d19613a42b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.603861 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ed842d-98d8-4903-811f-6d19613a42b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.604762 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ed842d-98d8-4903-811f-6d19613a42b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.605215 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ed842d-98d8-4903-811f-6d19613a42b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.605849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ed842d-98d8-4903-811f-6d19613a42b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.642051 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3f987b91-a123-4a7e-96f9-d52a55f8bb4b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:10.642682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3f987b91-a123-4a7e-96f9-d52a55f8bb4b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:10.661020 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3f987b91-a123-4a7e-96f9-d52a55f8bb4b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.661515 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3f987b91-a123-4a7e-96f9-d52a55f8bb4b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.661950 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3f987b91-a123-4a7e-96f9-d52a55f8bb4b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.662742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3f987b91-a123-4a7e-96f9-d52a55f8bb4b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.663203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3f987b91-a123-4a7e-96f9-d52a55f8bb4b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.663654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3f987b91-a123-4a7e-96f9-d52a55f8bb4b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.694856 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3f987b91-a123-4a7e-96f9-d52a55f8bb4b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:56:10.698023 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:10.766720 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-27ed842d-98d8-4903-811f-6d19613a42b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:10.775154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-27ed842d-98d8-4903-811f-6d19613a42b1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.185704 Aug 29 23:56:10.776225 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 321/663] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:10 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:10.780865 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-ddd1014f-f4ef-49e0-989c-f21225b0cb96 req-8451c91e-2a68-42a0-90ef-dab8878b5dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcf4e47-8d33-4c78-a889-876e9f941757", "name": "network-vif-plugged", "status": "completed", "tag": "9aab1db7-2f82-4fbf-b6c0-7f1a581d7326"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:10.791348 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ddd1014f-f4ef-49e0-989c-f21225b0cb96 req-8451c91e-2a68-42a0-90ef-dab8878b5dad service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:10.792263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ddd1014f-f4ef-49e0-989c-f21225b0cb96 req-8451c91e-2a68-42a0-90ef-dab8878b5dad service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:10.792263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ddd1014f-f4ef-49e0-989c-f21225b0cb96 req-8451c91e-2a68-42a0-90ef-dab8878b5dad service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:10.807066 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-ddd1014f-f4ef-49e0-989c-f21225b0cb96 req-8451c91e-2a68-42a0-90ef-dab8878b5dad service nova] Creating event network-vif-plugged:9aab1db7-2f82-4fbf-b6c0-7f1a581d7326 for instance 9fcf4e47-8d33-4c78-a889-876e9f941757 on hv-cinder-85427 Aug 29 23:56:10.811872 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-ddd1014f-f4ef-49e0-989c-f21225b0cb96 req-8451c91e-2a68-42a0-90ef-dab8878b5dad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034444 Aug 29 23:56:10.812525 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 322/664] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:10.998531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3f987b91-a123-4a7e-96f9-d52a55f8bb4b tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 204 len: 0 microversion: 2.1 time: 0.360353 Aug 29 23:56:10.999138 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 343/665] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:56:10 2022] DELETE /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:56:11.008099 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7169d415-53e0-45c9-83df-7a2eb9751a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:11.008793 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7169d415-53e0-45c9-83df-7a2eb9751a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:11.015249 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7169d415-53e0-45c9-83df-7a2eb9751a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:11.015730 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7169d415-53e0-45c9-83df-7a2eb9751a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:11.016159 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7169d415-53e0-45c9-83df-7a2eb9751a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:11.016950 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7169d415-53e0-45c9-83df-7a2eb9751a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:11.017401 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7169d415-53e0-45c9-83df-7a2eb9751a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:11.017816 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7169d415-53e0-45c9-83df-7a2eb9751a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:11.157763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7169d415-53e0-45c9-83df-7a2eb9751a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:11.166754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7169d415-53e0-45c9-83df-7a2eb9751a1a tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1688 microversion: 2.1 time: 0.162893 Aug 29 23:56:11.167338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 323/666] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:11 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:11.798683 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0bae3fd9-5075-4448-9c7e-41699cbac1e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:11.799394 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0bae3fd9-5075-4448-9c7e-41699cbac1e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:11.806316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0bae3fd9-5075-4448-9c7e-41699cbac1e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:11.806830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0bae3fd9-5075-4448-9c7e-41699cbac1e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:11.807274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0bae3fd9-5075-4448-9c7e-41699cbac1e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:11.807986 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0bae3fd9-5075-4448-9c7e-41699cbac1e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:11.808437 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0bae3fd9-5075-4448-9c7e-41699cbac1e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:11.808870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0bae3fd9-5075-4448-9c7e-41699cbac1e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:11.951576 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0bae3fd9-5075-4448-9c7e-41699cbac1e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:11.959882 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0bae3fd9-5075-4448-9c7e-41699cbac1e5 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.165085 Aug 29 23:56:11.960588 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 344/667] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:11 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:12.188144 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-16248f62-abac-47d2-b10b-181193970e17 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:12.188729 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-16248f62-abac-47d2-b10b-181193970e17 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:12.196333 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16248f62-abac-47d2-b10b-181193970e17 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:12.196822 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16248f62-abac-47d2-b10b-181193970e17 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:12.197251 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16248f62-abac-47d2-b10b-181193970e17 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:12.197977 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16248f62-abac-47d2-b10b-181193970e17 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:12.198452 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16248f62-abac-47d2-b10b-181193970e17 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:12.198869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-16248f62-abac-47d2-b10b-181193970e17 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:12.338003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-16248f62-abac-47d2-b10b-181193970e17 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:12.351404 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-16248f62-abac-47d2-b10b-181193970e17 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1688 microversion: 2.1 time: 0.166106 Aug 29 23:56:12.352130 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 324/668] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:12 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:13.051163 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-31700eab-6056-4bfc-b965-84f10efbd825 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:13.063389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-31700eab-6056-4bfc-b965-84f10efbd825 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:13.063389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-31700eab-6056-4bfc-b965-84f10efbd825 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.063389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-31700eab-6056-4bfc-b965-84f10efbd825 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.063389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-31700eab-6056-4bfc-b965-84f10efbd825 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.063799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-31700eab-6056-4bfc-b965-84f10efbd825 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.063799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-31700eab-6056-4bfc-b965-84f10efbd825 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.063799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-31700eab-6056-4bfc-b965-84f10efbd825 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.214154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-31700eab-6056-4bfc-b965-84f10efbd825 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:13.223253 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-31700eab-6056-4bfc-b965-84f10efbd825 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.244215 Aug 29 23:56:13.223825 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 345/669] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:12 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:13.375069 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-24ea3031-f1db-4cc2-920c-7f24ec6dfb3e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:13.375663 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-24ea3031-f1db-4cc2-920c-7f24ec6dfb3e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:13.382305 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-24ea3031-f1db-4cc2-920c-7f24ec6dfb3e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.383508 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-24ea3031-f1db-4cc2-920c-7f24ec6dfb3e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.383948 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-24ea3031-f1db-4cc2-920c-7f24ec6dfb3e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.384646 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-24ea3031-f1db-4cc2-920c-7f24ec6dfb3e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.385092 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-24ea3031-f1db-4cc2-920c-7f24ec6dfb3e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.385514 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-24ea3031-f1db-4cc2-920c-7f24ec6dfb3e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.523443 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-24ea3031-f1db-4cc2-920c-7f24ec6dfb3e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:13.531511 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-24ea3031-f1db-4cc2-920c-7f24ec6dfb3e tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1688 microversion: 2.1 time: 0.160155 Aug 29 23:56:13.532109 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 325/670] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:13 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:13.639244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8a691862-cee5-4bd3-97b8-b72e80b6254e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:13.639244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8a691862-cee5-4bd3-97b8-b72e80b6254e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:13.639244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a691862-cee5-4bd3-97b8-b72e80b6254e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.639244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a691862-cee5-4bd3-97b8-b72e80b6254e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.639925 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a691862-cee5-4bd3-97b8-b72e80b6254e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.639925 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a691862-cee5-4bd3-97b8-b72e80b6254e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.639925 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a691862-cee5-4bd3-97b8-b72e80b6254e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.639925 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8a691862-cee5-4bd3-97b8-b72e80b6254e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.735567 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8a691862-cee5-4bd3-97b8-b72e80b6254e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments/6bbce5a7-c6c2-4b74-8412-d78e56338085" status: 200 len: 194 microversion: 2.20 time: 0.123667 Aug 29 23:56:13.736174 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 346/671] 10.222.0.58 () {60 vars in 1454 bytes} [Mon Aug 29 23:56:13 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments/6bbce5a7-c6c2-4b74-8412-d78e56338085 => generated 194 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:56:13.807793 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-200b2336-4b4b-4f6b-9f1c-cca4374a5e7f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:13.808186 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-200b2336-4b4b-4f6b-9f1c-cca4374a5e7f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:13.815006 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-200b2336-4b4b-4f6b-9f1c-cca4374a5e7f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.815485 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-200b2336-4b4b-4f6b-9f1c-cca4374a5e7f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.815912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-200b2336-4b4b-4f6b-9f1c-cca4374a5e7f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.816606 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-200b2336-4b4b-4f6b-9f1c-cca4374a5e7f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:13.817052 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-200b2336-4b4b-4f6b-9f1c-cca4374a5e7f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:13.817473 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-200b2336-4b4b-4f6b-9f1c-cca4374a5e7f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:13.908406 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-200b2336-4b4b-4f6b-9f1c-cca4374a5e7f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lazy-loading 'services' on Instance uuid 781bf4fc-f6e6-4efc-b757-5888339b6b3c {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:14.109804 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-200b2336-4b4b-4f6b-9f1c-cca4374a5e7f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "DELETE /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments/6bbce5a7-c6c2-4b74-8412-d78e56338085" status: 202 len: 0 microversion: 2.20 time: 0.307250 Aug 29 23:56:14.110395 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 326/672] 10.222.0.58 () {60 vars in 1457 bytes} [Mon Aug 29 23:56:13 2022] DELETE /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments/6bbce5a7-c6c2-4b74-8412-d78e56338085 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:56:14.119746 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-93596653-a0f1-4d39-89ee-b239b6d431c6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:14.122047 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-93596653-a0f1-4d39-89ee-b239b6d431c6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:14.128860 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93596653-a0f1-4d39-89ee-b239b6d431c6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:14.129340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93596653-a0f1-4d39-89ee-b239b6d431c6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:14.129765 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93596653-a0f1-4d39-89ee-b239b6d431c6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:14.130479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93596653-a0f1-4d39-89ee-b239b6d431c6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:14.130950 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93596653-a0f1-4d39-89ee-b239b6d431c6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:14.131368 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93596653-a0f1-4d39-89ee-b239b6d431c6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:14.164336 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-93596653-a0f1-4d39-89ee-b239b6d431c6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048749 Aug 29 23:56:14.165129 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 347/673] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Aug 29 23:56:14 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:56:14.245467 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a7cf46bf-f8ea-4216-b570-dddca1539df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:14.246194 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a7cf46bf-f8ea-4216-b570-dddca1539df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:14.252353 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a7cf46bf-f8ea-4216-b570-dddca1539df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:14.252832 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a7cf46bf-f8ea-4216-b570-dddca1539df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:14.253263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a7cf46bf-f8ea-4216-b570-dddca1539df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:14.253952 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a7cf46bf-f8ea-4216-b570-dddca1539df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:14.254398 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a7cf46bf-f8ea-4216-b570-dddca1539df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:14.254851 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a7cf46bf-f8ea-4216-b570-dddca1539df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:14.386175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a7cf46bf-f8ea-4216-b570-dddca1539df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:14.394038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a7cf46bf-f8ea-4216-b570-dddca1539df4 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.153136 Aug 29 23:56:14.394645 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 327/674] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:14 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:14.554162 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7460e7f1-30db-40fd-9973-73779082ff55 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:14.555079 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7460e7f1-30db-40fd-9973-73779082ff55 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:14.561352 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7460e7f1-30db-40fd-9973-73779082ff55 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:14.566472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7460e7f1-30db-40fd-9973-73779082ff55 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:14.566472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7460e7f1-30db-40fd-9973-73779082ff55 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:14.566472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7460e7f1-30db-40fd-9973-73779082ff55 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:14.566472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7460e7f1-30db-40fd-9973-73779082ff55 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:14.566917 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7460e7f1-30db-40fd-9973-73779082ff55 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:14.718956 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7460e7f1-30db-40fd-9973-73779082ff55 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:14.728013 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7460e7f1-30db-40fd-9973-73779082ff55 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1688 microversion: 2.1 time: 0.178223 Aug 29 23:56:14.729018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 348/675] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:14 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:15.177227 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-36fc7e33-d184-4282-9c23-872d2fb7574a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:15.180120 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-36fc7e33-d184-4282-9c23-872d2fb7574a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:15.186954 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36fc7e33-d184-4282-9c23-872d2fb7574a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:15.187438 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36fc7e33-d184-4282-9c23-872d2fb7574a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:15.187894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36fc7e33-d184-4282-9c23-872d2fb7574a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:15.188579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36fc7e33-d184-4282-9c23-872d2fb7574a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:15.189018 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36fc7e33-d184-4282-9c23-872d2fb7574a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:15.189433 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36fc7e33-d184-4282-9c23-872d2fb7574a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:15.221612 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-36fc7e33-d184-4282-9c23-872d2fb7574a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048839 Aug 29 23:56:15.222184 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 328/676] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Aug 29 23:56:15 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:56:15.415720 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-96ea55fb-387e-457a-8d4c-7b0ae7b8ca4c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:15.416357 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-96ea55fb-387e-457a-8d4c-7b0ae7b8ca4c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:15.423119 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96ea55fb-387e-457a-8d4c-7b0ae7b8ca4c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:15.423676 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96ea55fb-387e-457a-8d4c-7b0ae7b8ca4c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:15.424104 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96ea55fb-387e-457a-8d4c-7b0ae7b8ca4c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:15.424789 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96ea55fb-387e-457a-8d4c-7b0ae7b8ca4c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:15.425262 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96ea55fb-387e-457a-8d4c-7b0ae7b8ca4c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:15.425677 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96ea55fb-387e-457a-8d4c-7b0ae7b8ca4c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:15.561606 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-96ea55fb-387e-457a-8d4c-7b0ae7b8ca4c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:15.569408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-96ea55fb-387e-457a-8d4c-7b0ae7b8ca4c tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1363 microversion: 2.1 time: 0.157996 Aug 29 23:56:15.570315 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 349/677] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:15 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:15.753381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f04b6264-91ef-454a-be53-6bbc7b5111ca tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:15.754243 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f04b6264-91ef-454a-be53-6bbc7b5111ca tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:15.767980 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f04b6264-91ef-454a-be53-6bbc7b5111ca tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:15.769287 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f04b6264-91ef-454a-be53-6bbc7b5111ca tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:15.770104 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f04b6264-91ef-454a-be53-6bbc7b5111ca tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:15.772390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f04b6264-91ef-454a-be53-6bbc7b5111ca tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:15.772973 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f04b6264-91ef-454a-be53-6bbc7b5111ca tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:15.773778 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f04b6264-91ef-454a-be53-6bbc7b5111ca tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:16.026279 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f04b6264-91ef-454a-be53-6bbc7b5111ca tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:16.035523 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f04b6264-91ef-454a-be53-6bbc7b5111ca tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1688 microversion: 2.1 time: 0.289405 Aug 29 23:56:16.050548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 329/678] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:15 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1688 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:16.236169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ff9b3cfb-6c26-45aa-b1aa-275801fd9be7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:16.238682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ff9b3cfb-6c26-45aa-b1aa-275801fd9be7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:16.246632 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff9b3cfb-6c26-45aa-b1aa-275801fd9be7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:16.247658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff9b3cfb-6c26-45aa-b1aa-275801fd9be7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:16.247658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff9b3cfb-6c26-45aa-b1aa-275801fd9be7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:16.249060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff9b3cfb-6c26-45aa-b1aa-275801fd9be7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:16.249532 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff9b3cfb-6c26-45aa-b1aa-275801fd9be7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:16.249961 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ff9b3cfb-6c26-45aa-b1aa-275801fd9be7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:16.289188 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ff9b3cfb-6c26-45aa-b1aa-275801fd9be7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056804 Aug 29 23:56:16.293521 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 350/679] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Aug 29 23:56:16 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:56:16.593787 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5f85710e-06b6-4bc7-88fa-a45a47284dc9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:16.594770 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5f85710e-06b6-4bc7-88fa-a45a47284dc9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:16.608239 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5f85710e-06b6-4bc7-88fa-a45a47284dc9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:16.609014 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5f85710e-06b6-4bc7-88fa-a45a47284dc9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:16.609719 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5f85710e-06b6-4bc7-88fa-a45a47284dc9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:16.610457 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5f85710e-06b6-4bc7-88fa-a45a47284dc9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:16.610934 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5f85710e-06b6-4bc7-88fa-a45a47284dc9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:16.611419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5f85710e-06b6-4bc7-88fa-a45a47284dc9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:16.857607 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5f85710e-06b6-4bc7-88fa-a45a47284dc9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:16.869976 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5f85710e-06b6-4bc7-88fa-a45a47284dc9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1549 microversion: 2.1 time: 0.283446 Aug 29 23:56:16.874478 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 330/680] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:16 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1549 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:16.894787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-40d93c55-c4b7-409f-9789-cf0e240f1560 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:16.894787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-40d93c55-c4b7-409f-9789-cf0e240f1560 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:16.899456 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-40d93c55-c4b7-409f-9789-cf0e240f1560 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:16.900230 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-40d93c55-c4b7-409f-9789-cf0e240f1560 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:16.900662 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-40d93c55-c4b7-409f-9789-cf0e240f1560 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:16.901576 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-40d93c55-c4b7-409f-9789-cf0e240f1560 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:16.902202 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-40d93c55-c4b7-409f-9789-cf0e240f1560 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:16.902838 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-40d93c55-c4b7-409f-9789-cf0e240f1560 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.067885 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9d9e0f99-ceac-4882-ac17-bef9e101beb7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:17.068818 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9d9e0f99-ceac-4882-ac17-bef9e101beb7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:17.079051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d9e0f99-ceac-4882-ac17-bef9e101beb7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.079870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d9e0f99-ceac-4882-ac17-bef9e101beb7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.080492 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d9e0f99-ceac-4882-ac17-bef9e101beb7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.083300 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d9e0f99-ceac-4882-ac17-bef9e101beb7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.085007 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d9e0f99-ceac-4882-ac17-bef9e101beb7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.086263 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9d9e0f99-ceac-4882-ac17-bef9e101beb7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.107897 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-40d93c55-c4b7-409f-9789-cf0e240f1560 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.220168 Aug 29 23:56:17.108496 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 351/681] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Aug 29 23:56:16 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:17.124702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-222dc6b8-ee95-4f76-acb5-62ea357a7129 req-b9716c1c-54db-4a6d-b04e-4875bf1ad4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c3a360a-1fe2-45f0-ad59-f9e69381ac28", "name": "network-vif-deleted", "tag": "4496c220-d785-47cc-8a05-42c8832bf15c"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:17.153905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-222dc6b8-ee95-4f76-acb5-62ea357a7129 req-b9716c1c-54db-4a6d-b04e-4875bf1ad4da service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.154763 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-222dc6b8-ee95-4f76-acb5-62ea357a7129 req-b9716c1c-54db-4a6d-b04e-4875bf1ad4da service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.155364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-222dc6b8-ee95-4f76-acb5-62ea357a7129 req-b9716c1c-54db-4a6d-b04e-4875bf1ad4da service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.184873 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-222dc6b8-ee95-4f76-acb5-62ea357a7129 req-b9716c1c-54db-4a6d-b04e-4875bf1ad4da service nova] Creating event network-vif-deleted:4496c220-d785-47cc-8a05-42c8832bf15c for instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 on hv-cinder-85427 Aug 29 23:56:17.211886 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9d9e0f99-ceac-4882-ac17-bef9e101beb7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:17.213095 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-222dc6b8-ee95-4f76-acb5-62ea357a7129 req-b9716c1c-54db-4a6d-b04e-4875bf1ad4da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093631 Aug 29 23:56:17.214808 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 352/682] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:17.221328 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9d9e0f99-ceac-4882-ac17-bef9e101beb7 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1621 microversion: 2.1 time: 0.159862 Aug 29 23:56:17.222088 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 331/683] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:17 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1621 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:17.306783 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a1e4071d-1eaa-478f-b815-59c73ed67cc5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:17.309479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a1e4071d-1eaa-478f-b815-59c73ed67cc5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:17.318213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a1e4071d-1eaa-478f-b815-59c73ed67cc5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.320377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a1e4071d-1eaa-478f-b815-59c73ed67cc5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.320377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a1e4071d-1eaa-478f-b815-59c73ed67cc5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.320377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a1e4071d-1eaa-478f-b815-59c73ed67cc5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.321010 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a1e4071d-1eaa-478f-b815-59c73ed67cc5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.321775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a1e4071d-1eaa-478f-b815-59c73ed67cc5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.356706 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a1e4071d-1eaa-478f-b815-59c73ed67cc5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056757 Aug 29 23:56:17.357532 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 353/684] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Aug 29 23:56:17 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:17.431024 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-064689c3-024c-4eaa-a0cd-e303e79ce3f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:17.431795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-064689c3-024c-4eaa-a0cd-e303e79ce3f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:17.440246 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-064689c3-024c-4eaa-a0cd-e303e79ce3f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.441060 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-064689c3-024c-4eaa-a0cd-e303e79ce3f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.441695 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-064689c3-024c-4eaa-a0cd-e303e79ce3f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.442663 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-064689c3-024c-4eaa-a0cd-e303e79ce3f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.443307 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-064689c3-024c-4eaa-a0cd-e303e79ce3f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.443913 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-064689c3-024c-4eaa-a0cd-e303e79ce3f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.496925 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-064689c3-024c-4eaa-a0cd-e303e79ce3f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Going to try to terminate instance {{(pid=127706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:56:17.882404 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-064689c3-024c-4eaa-a0cd-e303e79ce3f6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "DELETE /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 204 len: 0 microversion: 2.20 time: 0.455148 Aug 29 23:56:17.883038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 332/685] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Aug 29 23:56:17 2022] DELETE /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 23:56:17.891465 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:17.892857 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:17.900512 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.901116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.901430 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:17.902331 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:17.902842 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:17.903270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:18.170768 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:18.179350 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:18.181038 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:18.182221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-03f7ca7d-6ce9-4436-883f-2351eec52256 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.294811 Aug 29 23:56:18.182811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 354/686] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:17 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:18.247612 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:18.248306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:18.254837 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:18.255313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:18.255748 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:18.256439 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:18.256876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:18.257824 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:18.294546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:18.295033 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:18.295462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:18.295925 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lazy-loading 'fault' on Instance uuid 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:18.503620 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:18.511832 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-61ecf845-3dc0-4497-8ab8-43507a0abe77 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1334 microversion: 2.1 time: 0.268448 Aug 29 23:56:18.512451 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 333/687] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:18 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1334 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:19.206088 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:19.206845 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:19.214828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:19.215322 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:19.215764 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:19.216509 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:19.216967 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:19.217388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:19.234876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-be96c672-1527-4053-a173-ddc179d43b87 req-5d714f9f-504b-4db6-b878-c6434ebb80ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcf4e47-8d33-4c78-a889-876e9f941757", "tag": "9aab1db7-2f82-4fbf-b6c0-7f1a581d7326"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:19.246907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-be96c672-1527-4053-a173-ddc179d43b87 req-5d714f9f-504b-4db6-b878-c6434ebb80ec service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:19.247672 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-be96c672-1527-4053-a173-ddc179d43b87 req-5d714f9f-504b-4db6-b878-c6434ebb80ec service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:19.248126 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-be96c672-1527-4053-a173-ddc179d43b87 req-5d714f9f-504b-4db6-b878-c6434ebb80ec service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:19.251058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:19.261860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-be96c672-1527-4053-a173-ddc179d43b87 req-5d714f9f-504b-4db6-b878-c6434ebb80ec service nova] Creating event network-changed:9aab1db7-2f82-4fbf-b6c0-7f1a581d7326 for instance 9fcf4e47-8d33-4c78-a889-876e9f941757 on hv-cinder-85427 Aug 29 23:56:19.276322 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-be96c672-1527-4053-a173-ddc179d43b87 req-5d714f9f-504b-4db6-b878-c6434ebb80ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044950 Aug 29 23:56:19.276921 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 334/688] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:19.371623 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:19.379807 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:19.381267 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:19.383235 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-aa7ef2ca-5762-4341-a3c3-3df8bd34004e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.180266 Aug 29 23:56:19.383841 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 355/689] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:19 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:56:19.535051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:19.536349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:19.543497 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:19.543906 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:19.544339 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:19.545034 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:19.545505 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:19.545924 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:19.581974 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:19.582540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:19.582978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:19.583431 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lazy-loading 'fault' on Instance uuid 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:19.630012 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:19.639272 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-932c76b6-c6a5-4bab-815a-9b93d4419eb2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 200 len: 1334 microversion: 2.1 time: 0.109838 Aug 29 23:56:19.639853 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 335/690] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:19 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 1334 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:20.407066 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:20.407805 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:20.415214 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:20.415683 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:20.416120 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:20.416847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:20.417296 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:20.417718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:20.726486 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:20.738642 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:20.740583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:20.742112 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-510f6b07-0264-497a-a272-924b8841f7a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1722 microversion: 2.20 time: 0.339187 Aug 29 23:56:20.754818 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 356/691] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:20 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:20.800356 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:20.801038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: 5c3a360a-1fe2-45f0-ad59-f9e69381ac28] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:20.808223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:20.808702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:20.809135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:20.809841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:20.810282 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:20.810739 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:20.827140 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] HTTP exception thrown: Instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 could not be found. Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Request method failure captured: Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 HTTP/1.1 Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD4v-eu6rZBlAlqzwBcCkUx2NN4-TegknEgxG_yMBpHgCTjDu6aYx-1CgSWLVYCiicIRI8khSsWFJTLENz4gGINoHk92r89UKQyas6aJSylF_6htN8yd_yfF4ND3Mc7ip6d7BUL4TD_MMjoD6qH6Ivg1CAG_Ywi9Vp6la1BTmcb1Ak Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: cb38bc3ae5c14e4c8385809d84573600 Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:56:20.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb38bc3ae5c14e4c8385809d84573600", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: cb38bc3ae5c14e4c8385809d84573600 Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-ServerRescueNegativeTestJSON-660246268-project Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 734d44438bfb4a79a68aa6705e49b1e9 Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-ServerRescueNegativeTestJSON-660246268-project Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 could not be found. Aug 29 23:56:20.830603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '5c3a360a-1fe2-45f0-ad59-f9e69381ac28'} Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 could not be found. Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:20.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 could not be found. Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 could not be found. Aug 29 23:56:20.833064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:20.834462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Returning 404 to user: Instance 5c3a360a-1fe2-45f0-ad59-f9e69381ac28 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:20.834462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-18979d5d-b193-4d70-813e-6e46e4fbfee5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28" status: 404 len: 111 microversion: 2.1 time: 0.172909 Aug 29 23:56:20.834462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 336/692] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:20 2022] GET /compute/v2.1/servers/5c3a360a-1fe2-45f0-ad59-f9e69381ac28 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:56:20.839791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4474cbc9-3bb5-432d-9cf8-4413de990434 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '.version_select at 0x7fabbde954c0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:20.956615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4474cbc9-3bb5-432d-9cf8-4413de990434 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-644173455" status: 202 len: 0 microversion: 2.1 time: 0.121068 Aug 29 23:56:20.959822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 357/693] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Aug 29 23:56:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-644173455 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:56:21.328597 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-459f73d9-356e-4238-95b6-d0ed2ebb9b97 req-94daa23c-eb97-48e1-b89d-eec84ba443e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781bf4fc-f6e6-4efc-b757-5888339b6b3c", "name": "network-vif-deleted", "tag": "70011c53-2246-46a9-9308-734ee213614a"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:21.343160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-459f73d9-356e-4238-95b6-d0ed2ebb9b97 req-94daa23c-eb97-48e1-b89d-eec84ba443e3 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.343907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-459f73d9-356e-4238-95b6-d0ed2ebb9b97 req-94daa23c-eb97-48e1-b89d-eec84ba443e3 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.344527 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-459f73d9-356e-4238-95b6-d0ed2ebb9b97 req-94daa23c-eb97-48e1-b89d-eec84ba443e3 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.365189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-459f73d9-356e-4238-95b6-d0ed2ebb9b97 req-94daa23c-eb97-48e1-b89d-eec84ba443e3 service nova] Creating event network-vif-deleted:70011c53-2246-46a9-9308-734ee213614a for instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c on hv-cinder-85427 Aug 29 23:56:21.370878 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-459f73d9-356e-4238-95b6-d0ed2ebb9b97 req-94daa23c-eb97-48e1-b89d-eec84ba443e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046263 Aug 29 23:56:21.372081 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 337/694] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:21.774182 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:21.776382 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:21.789627 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.790892 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.792119 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.793672 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.794811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.795858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.845043 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:21.846007 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:21.846806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:21.847585 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lazy-loading 'fault' on Instance uuid 781bf4fc-f6e6-4efc-b757-5888339b6b3c {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:21.904238 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:21.914845 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:21.916457 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:21.920858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-49a050d7-1226-4c2c-9eb0-9b1eae016214 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 200 len: 1371 microversion: 2.20 time: 0.155160 Aug 29 23:56:21.920858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 358/695] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:21 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:22.943130 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:22.943821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:22.950880 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:22.951360 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:22.951802 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:22.952546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:22.952982 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:22.953396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:22.974757 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] HTTP exception thrown: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Request method failure captured: Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c HTTP/1.1 Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD9ahf4fITXYsvB7DkVxsPPZSBg88u42Xde891Stk2ZF_SftyM-VmtHlrVG-c-dgF4GJG68q8l5f05EcLDtTq5lhO__4-xNgr9qzXSPkzKg3Cv1FccN0Ad9633XTz9JzOziyBfZa76s0BLyEVRmecTDmOE72Jd1z4NFaBiqT4gLFrw Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:56:22.976495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd4107165644976b1d8cdbeec3c8711", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 90b2c6a74c29443b94d1577b39c7ce0b Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:56:22.978298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '781bf4fc-f6e6-4efc-b757-5888339b6b3c'} Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:22.979394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:56:22.980794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:22.982390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Returning 404 to user: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:22.982390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b52c96e9-a66f-48b7-bf58-02b28b98cc7c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 404 len: 111 microversion: 2.20 time: 0.039798 Aug 29 23:56:22.982390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 338/696] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:22 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:56:22.987019 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0058db22-0db4-4bb6-97a0-9d3c58902dbc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '.version_select at 0x7fabbdcdea60>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:23.111907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0058db22-0db4-4bb6-97a0-9d3c58902dbc tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-349114742" status: 204 len: 0 microversion: 2.20 time: 0.128768 Aug 29 23:56:23.112483 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 359/697] 10.222.0.58 () {60 vars in 1259 bytes} [Mon Aug 29 23:56:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-349114742 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 23:56:23.981182 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-378a2ca4-b1e5-4337-ab68-308a01c6238a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Action: 'create', calling method: .version_select at 0x7fabbdbb03a0>, body: {"keypair": {"name": "tempest-keypair-551696870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPimloj0FCQt0sZ8G7MuEfmFb/rD/8DR3gG3EwxUQ6Ag7G3Mt/43tR1FNmEOOIqWoCUUglBvJJHnZUihq7uBTZn4GeM6ZtIgotSDA1tQJNITuG7Hs0Kb5Zd5YFh5bRsA5g=="}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:23.998012 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-378a2ca4-b1e5-4337-ab68-308a01c6238a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Getting quotas for project 3fd4107165644976b1d8cdbeec3c8711. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:56:24.001790 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-378a2ca4-b1e5-4337-ab68-308a01c6238a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Getting quotas for user 90b2c6a74c29443b94d1577b39c7ce0b and project 3fd4107165644976b1d8cdbeec3c8711. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:56:24.073256 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-378a2ca4-b1e5-4337-ab68-308a01c6238a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.096026 Aug 29 23:56:24.073852 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 339/698] 10.222.0.58 () {62 vars in 1200 bytes} [Mon Aug 29 23:56:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 29 23:56:24.435568 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e7456785-d2f6-4d7b-a2d1-1bf2ce66c8cc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:24.436138 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e7456785-d2f6-4d7b-a2d1-1bf2ce66c8cc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:24.443575 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e7456785-d2f6-4d7b-a2d1-1bf2ce66c8cc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:24.444537 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e7456785-d2f6-4d7b-a2d1-1bf2ce66c8cc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:24.444537 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e7456785-d2f6-4d7b-a2d1-1bf2ce66c8cc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:24.445297 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e7456785-d2f6-4d7b-a2d1-1bf2ce66c8cc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:24.445752 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e7456785-d2f6-4d7b-a2d1-1bf2ce66c8cc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:24.446213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e7456785-d2f6-4d7b-a2d1-1bf2ce66c8cc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:24.477717 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e7456785-d2f6-4d7b-a2d1-1bf2ce66c8cc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:56:24.506694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:24.837919 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e7456785-d2f6-4d7b-a2d1-1bf2ce66c8cc tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 204 len: 0 microversion: 2.1 time: 0.405313 Aug 29 23:56:24.838695 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 360/699] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:56:24 2022] DELETE /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:56:24.850500 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f1feada9-8607-4bbc-a7e4-814894c591ae tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:24.851329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f1feada9-8607-4bbc-a7e4-814894c591ae tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:24.858669 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f1feada9-8607-4bbc-a7e4-814894c591ae tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:24.859159 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f1feada9-8607-4bbc-a7e4-814894c591ae tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:24.859595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f1feada9-8607-4bbc-a7e4-814894c591ae tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:24.860312 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f1feada9-8607-4bbc-a7e4-814894c591ae tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:24.860765 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f1feada9-8607-4bbc-a7e4-814894c591ae tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:24.861189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f1feada9-8607-4bbc-a7e4-814894c591ae tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:25.042319 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f1feada9-8607-4bbc-a7e4-814894c591ae tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:25.056888 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f1feada9-8607-4bbc-a7e4-814894c591ae tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1508 microversion: 2.1 time: 0.212225 Aug 29 23:56:25.057961 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 340/700] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:24 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:26.080599 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b24db9b9-34d3-4f8e-a820-baff4d5b1fb8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:26.081720 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b24db9b9-34d3-4f8e-a820-baff4d5b1fb8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:26.091681 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b24db9b9-34d3-4f8e-a820-baff4d5b1fb8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.092446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b24db9b9-34d3-4f8e-a820-baff4d5b1fb8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.093701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b24db9b9-34d3-4f8e-a820-baff4d5b1fb8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.094493 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b24db9b9-34d3-4f8e-a820-baff4d5b1fb8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:26.095114 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b24db9b9-34d3-4f8e-a820-baff4d5b1fb8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:26.095663 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b24db9b9-34d3-4f8e-a820-baff4d5b1fb8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:26.260974 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b24db9b9-34d3-4f8e-a820-baff4d5b1fb8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:26.270956 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b24db9b9-34d3-4f8e-a820-baff4d5b1fb8 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1508 microversion: 2.1 time: 0.195177 Aug 29 23:56:26.271564 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 361/701] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:26 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:26.648701 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-279535469", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39f95710-f788-408d-8a65-e81984f3a974"}], "security_groups": [{"name": "tempest-securitygroup--1033765527"}], "key_name": "tempest-keypair-551696870", "user_data": "}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:26.759614 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] validate_networks() for [('39f95710-f788-408d-8a65-e81984f3a974', None, None, None, None, None)] {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:56:27.230821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:56:27.231351 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:56:27.231917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:56:27.232494 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:56:27.232992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:56:27.245205 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:27.246061 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:27.246871 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:27.248253 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:27.249070 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:27.249849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:27.278676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Getting quotas for project 3fd4107165644976b1d8cdbeec3c8711. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:56:27.283384 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Getting quotas for user 90b2c6a74c29443b94d1577b39c7ce0b and project 3fd4107165644976b1d8cdbeec3c8711. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:56:27.293884 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5f5de248-e061-4085-95c9-5c2d778db27d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:27.294871 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-5f5de248-e061-4085-95c9-5c2d778db27d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:27.296272 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:56:27.299037 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:56:27.304049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f5de248-e061-4085-95c9-5c2d778db27d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:27.304664 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f5de248-e061-4085-95c9-5c2d778db27d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:27.305106 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f5de248-e061-4085-95c9-5c2d778db27d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:27.305864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f5de248-e061-4085-95c9-5c2d778db27d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:27.306362 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f5de248-e061-4085-95c9-5c2d778db27d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:27.306863 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5f5de248-e061-4085-95c9-5c2d778db27d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:27.422933 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-15e931ce-3806-4d6f-a9e2-da68feaa9aee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.833939 Aug 29 23:56:27.430755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 341/702] 10.222.0.58 () {62 vars in 1188 bytes} [Mon Aug 29 23:56:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 23:56:27.436090 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7a5df6b5-e7f0-49f8-adf4-b3b20d28f7bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:27.436702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7a5df6b5-e7f0-49f8-adf4-b3b20d28f7bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:27.562163 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7a5df6b5-e7f0-49f8-adf4-b3b20d28f7bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:27.576712 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7a5df6b5-e7f0-49f8-adf4-b3b20d28f7bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:27.579975 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7a5df6b5-e7f0-49f8-adf4-b3b20d28f7bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:27.582228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7a5df6b5-e7f0-49f8-adf4-b3b20d28f7bd tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1280 microversion: 2.20 time: 0.149680 Aug 29 23:56:27.583162 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 342/703] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:27 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1280 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:27.603890 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5f5de248-e061-4085-95c9-5c2d778db27d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:27.612254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5f5de248-e061-4085-95c9-5c2d778db27d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1508 microversion: 2.1 time: 0.323328 Aug 29 23:56:27.619539 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 362/704] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:27 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:28.417781 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-9a647f0b-1f91-49c3-a569-e429b86169f6 req-05e1c86f-8899-4da2-88a5-a79cdd42c2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d83695-337c-4680-ac86-9e9aa83f52f0", "name": "network-vif-deleted", "tag": "a3bc2dbb-5f57-4183-b6af-6edb5fc60c9c"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:28.429619 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-9a647f0b-1f91-49c3-a569-e429b86169f6 req-05e1c86f-8899-4da2-88a5-a79cdd42c2b9 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:28.430105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-9a647f0b-1f91-49c3-a569-e429b86169f6 req-05e1c86f-8899-4da2-88a5-a79cdd42c2b9 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:28.430599 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-9a647f0b-1f91-49c3-a569-e429b86169f6 req-05e1c86f-8899-4da2-88a5-a79cdd42c2b9 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:28.442415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-9a647f0b-1f91-49c3-a569-e429b86169f6 req-05e1c86f-8899-4da2-88a5-a79cdd42c2b9 service nova] Creating event network-vif-deleted:a3bc2dbb-5f57-4183-b6af-6edb5fc60c9c for instance e5d83695-337c-4680-ac86-9e9aa83f52f0 on hv-cinder-85427 Aug 29 23:56:28.447751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-9a647f0b-1f91-49c3-a569-e429b86169f6 req-05e1c86f-8899-4da2-88a5-a79cdd42c2b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034388 Aug 29 23:56:28.448621 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 343/705] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:28.611054 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fe87336c-a3a2-4091-99fd-735126e5af7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:28.611679 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fe87336c-a3a2-4091-99fd-735126e5af7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:28.636592 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-dffeff55-147b-4ace-ad3c-c3de238a39c4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:28.637495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-dffeff55-147b-4ace-ad3c-c3de238a39c4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:28.644348 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dffeff55-147b-4ace-ad3c-c3de238a39c4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:28.644839 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dffeff55-147b-4ace-ad3c-c3de238a39c4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:28.645313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dffeff55-147b-4ace-ad3c-c3de238a39c4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:28.646021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dffeff55-147b-4ace-ad3c-c3de238a39c4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:28.646502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dffeff55-147b-4ace-ad3c-c3de238a39c4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:28.646929 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dffeff55-147b-4ace-ad3c-c3de238a39c4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:28.669222 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fe87336c-a3a2-4091-99fd-735126e5af7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:28.677629 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fe87336c-a3a2-4091-99fd-735126e5af7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:28.679104 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fe87336c-a3a2-4091-99fd-735126e5af7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:28.684090 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fe87336c-a3a2-4091-99fd-735126e5af7d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1280 microversion: 2.20 time: 0.076056 Aug 29 23:56:28.684090 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 363/706] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:28 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:28.714501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-dffeff55-147b-4ace-ad3c-c3de238a39c4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:28.720516 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-dffeff55-147b-4ace-ad3c-c3de238a39c4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1292 microversion: 2.1 time: 0.088394 Aug 29 23:56:28.721089 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 344/707] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:28 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:29.702776 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:29.703714 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:29.711202 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.711878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.712370 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.713065 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.713549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.713962 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.741010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:29.742382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:29.748828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.750965 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.753617 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.754750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.755419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.755865 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.791852 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:29.792014 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:29.792536 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:29.793329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:29.793639 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lazy-loading 'fault' on Instance uuid e5d83695-337c-4680-ac86-9e9aa83f52f0 {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:29.800577 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:29.802015 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:29.803147 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9a0295bb-c911-4a75-942e-a5fb55dfbae5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1332 microversion: 2.20 time: 0.104343 Aug 29 23:56:29.804339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 364/708] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:29 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:56:29.838664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:29.846683 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-33637183-52aa-445a-9260-c8e5d2e7b5f5 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 200 len: 1311 microversion: 2.1 time: 0.109451 Aug 29 23:56:29.847274 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 345/709] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:29 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:30.827646 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:30.828234 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:30.834907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:30.835499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:30.835937 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:30.836662 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:30.837105 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:30.837518 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:30.868869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:30.869785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: e5d83695-337c-4680-ac86-9e9aa83f52f0] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:30.876539 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:30.877017 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:30.877450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:30.878259 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:30.878693 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:30.879126 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:30.894627 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] HTTP exception thrown: Instance e5d83695-337c-4680-ac86-9e9aa83f52f0 could not be found. Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Request method failure captured: Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 HTTP/1.1 Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD4v-eu6rZBlAlqzwBcCkUx2NN4-TegknEgxG_yMBpHgCTjDu6aYx-1CgSWLVYCiicIRI8khSsWFJTLENz4gGINoHk92r89UKQyas6aJSylF_6htN8yd_yfF4ND3Mc7ip6d7BUL4TD_MMjoD6qH6Ivg1CAG_Ywi9Vp6la1BTmcb1Ak Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: cb38bc3ae5c14e4c8385809d84573600 Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:56:30.896691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb38bc3ae5c14e4c8385809d84573600", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: cb38bc3ae5c14e4c8385809d84573600 Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-ServerRescueNegativeTestJSON-660246268-project Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 734d44438bfb4a79a68aa6705e49b1e9 Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-ServerRescueNegativeTestJSON-660246268-project Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance e5d83695-337c-4680-ac86-9e9aa83f52f0 could not be found. Aug 29 23:56:30.898363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': 'e5d83695-337c-4680-ac86-9e9aa83f52f0'} Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d83695-337c-4680-ac86-9e9aa83f52f0 could not be found. Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:30.901898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d83695-337c-4680-ac86-9e9aa83f52f0 could not be found. Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d83695-337c-4680-ac86-9e9aa83f52f0 could not be found. Aug 29 23:56:30.903149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:30.904223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Returning 404 to user: Instance e5d83695-337c-4680-ac86-9e9aa83f52f0 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:30.904223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a9b25885-1081-4205-b696-02ffbc64cf7c tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0" status: 404 len: 111 microversion: 2.1 time: 0.033670 Aug 29 23:56:30.904223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 346/710] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:30 2022] GET /compute/v2.1/servers/e5d83695-337c-4680-ac86-9e9aa83f52f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:56:30.906924 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-00ba6a4c-e3a2-42e8-b26a-cd21e7500166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:30.907417 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-00ba6a4c-e3a2-42e8-b26a-cd21e7500166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:30.914178 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00ba6a4c-e3a2-42e8-b26a-cd21e7500166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:30.914650 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00ba6a4c-e3a2-42e8-b26a-cd21e7500166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:30.915082 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00ba6a4c-e3a2-42e8-b26a-cd21e7500166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:30.915811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00ba6a4c-e3a2-42e8-b26a-cd21e7500166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:30.916264 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00ba6a4c-e3a2-42e8-b26a-cd21e7500166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:30.916690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-00ba6a4c-e3a2-42e8-b26a-cd21e7500166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:30.928185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:30.938197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:30.939726 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:30.940873 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-16b1540c-ddc4-4b74-9044-d46ab7ef5ad8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1338 microversion: 2.20 time: 0.117265 Aug 29 23:56:30.941591 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 365/711] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:30 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1338 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:56:30.945114 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-00ba6a4c-e3a2-42e8-b26a-cd21e7500166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Going to try to terminate instance {{(pid=127706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:56:31.202514 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:31.341117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-00ba6a4c-e3a2-42e8-b26a-cd21e7500166 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 204 len: 0 microversion: 2.1 time: 0.437451 Aug 29 23:56:31.341727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 347/712] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:56:30 2022] DELETE /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:56:31.358735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6c267086-4c68-47ed-97a2-18a97f5dde59 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:31.359375 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6c267086-4c68-47ed-97a2-18a97f5dde59 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:31.365968 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6c267086-4c68-47ed-97a2-18a97f5dde59 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:31.366499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6c267086-4c68-47ed-97a2-18a97f5dde59 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:31.366960 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6c267086-4c68-47ed-97a2-18a97f5dde59 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:31.367844 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6c267086-4c68-47ed-97a2-18a97f5dde59 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:31.368166 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6c267086-4c68-47ed-97a2-18a97f5dde59 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:31.368566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6c267086-4c68-47ed-97a2-18a97f5dde59 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:31.620170 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6c267086-4c68-47ed-97a2-18a97f5dde59 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:31.628617 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6c267086-4c68-47ed-97a2-18a97f5dde59 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.277215 Aug 29 23:56:31.629303 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 366/713] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:31 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:31.968201 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:31.969187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:31.976125 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:31.976506 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:31.976979 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:31.977705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:31.978198 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:31.978654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:32.120123 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:32.129076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:32.130555 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:32.131748 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0f7a4107-9125-434f-9a8b-6978aa59ce0b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1406 microversion: 2.20 time: 0.168014 Aug 29 23:56:32.133243 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 348/714] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:31 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:32.145228 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-29a90ecc-0921-4f7a-818c-a277ed7c6aa2 req-0ed0b6c4-79fc-42d3-aea7-4e0246fcd200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a5a820-1da2-47e6-b6e9-6586034c7fcf", "tag": "92bd74c9-1028-4a8d-a703-f5c8f8637fc5"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:32.155645 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-29a90ecc-0921-4f7a-818c-a277ed7c6aa2 req-0ed0b6c4-79fc-42d3-aea7-4e0246fcd200 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:32.158455 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-29a90ecc-0921-4f7a-818c-a277ed7c6aa2 req-0ed0b6c4-79fc-42d3-aea7-4e0246fcd200 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:32.158455 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-29a90ecc-0921-4f7a-818c-a277ed7c6aa2 req-0ed0b6c4-79fc-42d3-aea7-4e0246fcd200 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:32.170616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-29a90ecc-0921-4f7a-818c-a277ed7c6aa2 req-0ed0b6c4-79fc-42d3-aea7-4e0246fcd200 service nova] Creating event network-changed:92bd74c9-1028-4a8d-a703-f5c8f8637fc5 for instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf on hv-cinder-85427 Aug 29 23:56:32.175446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-29a90ecc-0921-4f7a-818c-a277ed7c6aa2 req-0ed0b6c4-79fc-42d3-aea7-4e0246fcd200 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034507 Aug 29 23:56:32.176056 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 367/715] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:32.649800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4ab4d5a1-9506-44e7-a632-dea2ef589fef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:32.650324 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4ab4d5a1-9506-44e7-a632-dea2ef589fef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:32.657073 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ab4d5a1-9506-44e7-a632-dea2ef589fef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:32.657569 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ab4d5a1-9506-44e7-a632-dea2ef589fef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:32.658005 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ab4d5a1-9506-44e7-a632-dea2ef589fef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:32.658780 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ab4d5a1-9506-44e7-a632-dea2ef589fef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:32.659239 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ab4d5a1-9506-44e7-a632-dea2ef589fef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:32.659661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ab4d5a1-9506-44e7-a632-dea2ef589fef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:32.795261 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-4ab4d5a1-9506-44e7-a632-dea2ef589fef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:32.803190 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4ab4d5a1-9506-44e7-a632-dea2ef589fef tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.157751 Aug 29 23:56:32.803757 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 349/716] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:32 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:33.159216 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:33.160429 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:33.170056 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:33.170639 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:33.170999 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:33.171702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:33.172141 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:33.172551 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:33.311515 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:33.320742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:33.322213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:33.323364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-10624b1b-95de-4258-8b50-02c178524604 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1406 microversion: 2.20 time: 0.171567 Aug 29 23:56:33.323913 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 368/717] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:33 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:33.810988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6bbbf747-6d30-4bb6-94a6-78e32bed3e1c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-860543102"}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:33.811544 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6bbbf747-6d30-4bb6-94a6-78e32bed3e1c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:33.817879 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6bbbf747-6d30-4bb6-94a6-78e32bed3e1c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:33.818365 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6bbbf747-6d30-4bb6-94a6-78e32bed3e1c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:33.818829 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6bbbf747-6d30-4bb6-94a6-78e32bed3e1c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:33.819656 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6bbbf747-6d30-4bb6-94a6-78e32bed3e1c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:33.820860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6bbbf747-6d30-4bb6-94a6-78e32bed3e1c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:33.821289 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6bbbf747-6d30-4bb6-94a6-78e32bed3e1c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:33.825387 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f165d138-f4dd-48b9-a1b5-3c4953ec4bfd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:33.825993 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f165d138-f4dd-48b9-a1b5-3c4953ec4bfd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:33.827969 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:33.832535 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f165d138-f4dd-48b9-a1b5-3c4953ec4bfd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:33.833019 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f165d138-f4dd-48b9-a1b5-3c4953ec4bfd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:33.833450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f165d138-f4dd-48b9-a1b5-3c4953ec4bfd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:33.834139 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f165d138-f4dd-48b9-a1b5-3c4953ec4bfd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:33.834619 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f165d138-f4dd-48b9-a1b5-3c4953ec4bfd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:33.835033 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f165d138-f4dd-48b9-a1b5-3c4953ec4bfd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.011874 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.network.security_group_api [None req-6bbbf747-6d30-4bb6-94a6-78e32bed3e1c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Removing security group 723296f3-4626-4b62-901e-ad88d9e088cf from port 4bfeae22-1324-4d1f-9b5f-0d481c03c512 Aug 29 23:56:34.037013 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f165d138-f4dd-48b9-a1b5-3c4953ec4bfd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:34.045029 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f165d138-f4dd-48b9-a1b5-3c4953ec4bfd tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.223684 Aug 29 23:56:34.045648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 369/718] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:33 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:34.348200 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:34.349699 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:34.357591 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.358018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.358473 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.359184 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.359635 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.360063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.465247 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6bbbf747-6d30-4bb6-94a6-78e32bed3e1c tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "POST /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/action" status: 202 len: 0 microversion: 2.1 time: 0.658058 Aug 29 23:56:34.468812 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 350/719] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Aug 29 23:56:33 2022] POST /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/action => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:56:34.479763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-47cd8396-e988-4282-ade6-8270b7ccb0f8 req-3e534871-aa06-460c-b816-0df3f6fd7a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80567224-9d47-4087-b154-85564c2987cd", "tag": "4bfeae22-1324-4d1f-9b5f-0d481c03c512"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:34.493441 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-47cd8396-e988-4282-ade6-8270b7ccb0f8 req-3e534871-aa06-460c-b816-0df3f6fd7a28 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:34.495289 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-47cd8396-e988-4282-ade6-8270b7ccb0f8 req-3e534871-aa06-460c-b816-0df3f6fd7a28 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:34.506190 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-47cd8396-e988-4282-ade6-8270b7ccb0f8 req-3e534871-aa06-460c-b816-0df3f6fd7a28 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:34.532398 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-47cd8396-e988-4282-ade6-8270b7ccb0f8 req-3e534871-aa06-460c-b816-0df3f6fd7a28 service nova] Creating event network-changed:4bfeae22-1324-4d1f-9b5f-0d481c03c512 for instance 80567224-9d47-4087-b154-85564c2987cd on hv-cinder-85427 Aug 29 23:56:34.540604 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-47cd8396-e988-4282-ade6-8270b7ccb0f8 req-3e534871-aa06-460c-b816-0df3f6fd7a28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065166 Aug 29 23:56:34.542206 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 351/720] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:34.715130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:34.733043 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:34.734556 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:34.736083 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-437e1044-498f-45d8-a1c3-0d8a9abe6dec tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1406 microversion: 2.20 time: 0.392361 Aug 29 23:56:34.736980 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 370/721] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:34 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:56:35.071467 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-acda81ab-d821-4226-aef3-9dfc124073f4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:35.072821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-acda81ab-d821-4226-aef3-9dfc124073f4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:35.079506 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-acda81ab-d821-4226-aef3-9dfc124073f4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:35.080083 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-acda81ab-d821-4226-aef3-9dfc124073f4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:35.080625 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-acda81ab-d821-4226-aef3-9dfc124073f4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:35.081426 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-acda81ab-d821-4226-aef3-9dfc124073f4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:35.081946 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-acda81ab-d821-4226-aef3-9dfc124073f4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:35.082464 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-acda81ab-d821-4226-aef3-9dfc124073f4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:35.425423 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-acda81ab-d821-4226-aef3-9dfc124073f4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:35.436495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-acda81ab-d821-4226-aef3-9dfc124073f4 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1521 microversion: 2.1 time: 0.373315 Aug 29 23:56:35.437097 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 352/722] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:35 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:35.760423 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:35.761082 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:35.768154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:35.768758 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:35.769266 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:35.770050 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:35.770629 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:35.771154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.028861 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:36.039801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:36.043742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:36.045383 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-227c317a-0ec7-46a7-8498-b3032de92b07 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1406 microversion: 2.20 time: 0.289759 Aug 29 23:56:36.046243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 371/723] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:35 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:56:36.075346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-ad00d653-5dcd-4211-98af-14234b882a57 req-6a57c35c-18c2-4918-bbcc-f5fe37d59f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edecb793-ad02-4b6f-addc-020ce872a118", "name": "network-vif-deleted", "tag": "a058a5e2-fffb-402f-99cc-4946054648c3"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:36.087575 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ad00d653-5dcd-4211-98af-14234b882a57 req-6a57c35c-18c2-4918-bbcc-f5fe37d59f14 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:36.088117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ad00d653-5dcd-4211-98af-14234b882a57 req-6a57c35c-18c2-4918-bbcc-f5fe37d59f14 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:36.088545 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ad00d653-5dcd-4211-98af-14234b882a57 req-6a57c35c-18c2-4918-bbcc-f5fe37d59f14 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.103089 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-ad00d653-5dcd-4211-98af-14234b882a57 req-6a57c35c-18c2-4918-bbcc-f5fe37d59f14 service nova] Creating event network-vif-deleted:a058a5e2-fffb-402f-99cc-4946054648c3 for instance edecb793-ad02-4b6f-addc-020ce872a118 on hv-cinder-85427 Aug 29 23:56:36.108375 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-ad00d653-5dcd-4211-98af-14234b882a57 req-6a57c35c-18c2-4918-bbcc-f5fe37d59f14 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036865 Aug 29 23:56:36.109673 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 353/724] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:36.459515 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7520e8d9-bfd6-439d-9892-4147ec07e53d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:36.466215 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7520e8d9-bfd6-439d-9892-4147ec07e53d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:36.476394 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7520e8d9-bfd6-439d-9892-4147ec07e53d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:36.486726 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7520e8d9-bfd6-439d-9892-4147ec07e53d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:36.487185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7520e8d9-bfd6-439d-9892-4147ec07e53d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.487941 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7520e8d9-bfd6-439d-9892-4147ec07e53d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:36.488401 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7520e8d9-bfd6-439d-9892-4147ec07e53d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:36.488862 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7520e8d9-bfd6-439d-9892-4147ec07e53d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.496497 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-145e55f1-9c3e-49ba-9fae-b7d7aaf445d8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:36.497079 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-145e55f1-9c3e-49ba-9fae-b7d7aaf445d8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:36.503558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-145e55f1-9c3e-49ba-9fae-b7d7aaf445d8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:36.504182 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-145e55f1-9c3e-49ba-9fae-b7d7aaf445d8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:36.504620 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-145e55f1-9c3e-49ba-9fae-b7d7aaf445d8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.505315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-145e55f1-9c3e-49ba-9fae-b7d7aaf445d8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:36.506231 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-145e55f1-9c3e-49ba-9fae-b7d7aaf445d8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:36.506231 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-145e55f1-9c3e-49ba-9fae-b7d7aaf445d8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.576817 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7520e8d9-bfd6-439d-9892-4147ec07e53d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:36.586270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7520e8d9-bfd6-439d-9892-4147ec07e53d tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1306 microversion: 2.1 time: 0.130607 Aug 29 23:56:36.587019 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 372/725] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:36 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1306 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:36.597333 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-145e55f1-9c3e-49ba-9fae-b7d7aaf445d8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lazy-loading 'services' on Instance uuid 80567224-9d47-4087-b154-85564c2987cd {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:36.859131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-145e55f1-9c3e-49ba-9fae-b7d7aaf445d8 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "DELETE /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments/974b8208-99fd-40b5-a9ca-af647057f0ae" status: 202 len: 0 microversion: 2.1 time: 0.372833 Aug 29 23:56:36.859956 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 354/726] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Aug 29 23:56:36 2022] DELETE /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments/974b8208-99fd-40b5-a9ca-af647057f0ae => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:56:36.868818 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-77dde99a-283a-44e3-8268-1fdffba6927f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:36.871025 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-77dde99a-283a-44e3-8268-1fdffba6927f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:36.877676 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77dde99a-283a-44e3-8268-1fdffba6927f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:36.878159 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77dde99a-283a-44e3-8268-1fdffba6927f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:36.878617 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77dde99a-283a-44e3-8268-1fdffba6927f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.879361 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77dde99a-283a-44e3-8268-1fdffba6927f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:36.879767 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77dde99a-283a-44e3-8268-1fdffba6927f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:36.880184 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77dde99a-283a-44e3-8268-1fdffba6927f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:36.910520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-77dde99a-283a-44e3-8268-1fdffba6927f tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046128 Aug 29 23:56:36.911099 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 373/727] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:36 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:37.070923 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:37.071821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:37.079176 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.080131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.080616 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.081022 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.081467 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.081952 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.264030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:37.270894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:37.280773 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:37.282394 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:37.283532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-dbc83413-665c-4e9b-ab5d-7869ec089f7b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1406 microversion: 2.20 time: 0.218106 Aug 29 23:56:37.284088 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 355/728] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:37 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:37.608121 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:37.608907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:37.616235 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.617105 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.617746 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.618474 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.618930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.619348 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.651956 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.652430 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.652854 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.653287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lazy-loading 'fault' on Instance uuid edecb793-ad02-4b6f-addc-020ce872a118 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:37.696214 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '734d44438bfb4a79a68aa6705e49b1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb38bc3ae5c14e4c8385809d84573600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:37.704313 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-08207ddd-ab57-48bf-9093-d94e29166e76 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 200 len: 1311 microversion: 2.1 time: 0.100126 Aug 29 23:56:37.704874 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 374/729] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:37 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:37.924612 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2bcbee57-a6a6-4492-9784-4a43341b700a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:37.926798 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2bcbee57-a6a6-4492-9784-4a43341b700a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:37.929092 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=12 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:37.934233 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2bcbee57-a6a6-4492-9784-4a43341b700a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.934754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2bcbee57-a6a6-4492-9784-4a43341b700a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.935196 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2bcbee57-a6a6-4492-9784-4a43341b700a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.935904 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2bcbee57-a6a6-4492-9784-4a43341b700a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:37.936364 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2bcbee57-a6a6-4492-9784-4a43341b700a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:37.936788 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2bcbee57-a6a6-4492-9784-4a43341b700a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:37.939595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:37.974209 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2bcbee57-a6a6-4492-9784-4a43341b700a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053601 Aug 29 23:56:37.974860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 356/730] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:37 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:38.124256 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-9aeb61ca-c63c-47fc-8a61-dcfec3b7938e req-5e08bd23-3cc2-4d1f-96ab-1bd2f2644694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80567224-9d47-4087-b154-85564c2987cd", "tag": "4bfeae22-1324-4d1f-9b5f-0d481c03c512"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:38.134894 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-9aeb61ca-c63c-47fc-8a61-dcfec3b7938e req-5e08bd23-3cc2-4d1f-96ab-1bd2f2644694 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.135364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-9aeb61ca-c63c-47fc-8a61-dcfec3b7938e req-5e08bd23-3cc2-4d1f-96ab-1bd2f2644694 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:38.135785 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-9aeb61ca-c63c-47fc-8a61-dcfec3b7938e req-5e08bd23-3cc2-4d1f-96ab-1bd2f2644694 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:38.149512 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-9aeb61ca-c63c-47fc-8a61-dcfec3b7938e req-5e08bd23-3cc2-4d1f-96ab-1bd2f2644694 service nova] Creating event network-changed:4bfeae22-1324-4d1f-9b5f-0d481c03c512 for instance 80567224-9d47-4087-b154-85564c2987cd on hv-cinder-85427 Aug 29 23:56:38.154666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-9aeb61ca-c63c-47fc-8a61-dcfec3b7938e req-5e08bd23-3cc2-4d1f-96ab-1bd2f2644694 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034051 Aug 29 23:56:38.155361 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 375/731] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:38.308071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:38.308692 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:38.317179 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.324042 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:38.324042 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:38.324042 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.324042 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:38.324691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:38.726533 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:38.730755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:38.731465 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] [instance: edecb793-ad02-4b6f-addc-020ce872a118] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:38.740806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.740806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:38.740806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:38.740806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.741450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:38.741450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:38.754026 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] HTTP exception thrown: Instance edecb793-ad02-4b6f-addc-020ce872a118 could not be found. Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Request method failure captured: Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 HTTP/1.1 Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD4v-eu6rZBlAlqzwBcCkUx2NN4-TegknEgxG_yMBpHgCTjDu6aYx-1CgSWLVYCiicIRI8khSsWFJTLENz4gGINoHk92r89UKQyas6aJSylF_6htN8yd_yfF4ND3Mc7ip6d7BUL4TD_MMjoD6qH6Ivg1CAG_Ywi9Vp6la1BTmcb1Ak Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: cb38bc3ae5c14e4c8385809d84573600 Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:56:38.755728 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb38bc3ae5c14e4c8385809d84573600"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb38bc3ae5c14e4c8385809d84573600", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: cb38bc3ae5c14e4c8385809d84573600 Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-660246268 Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-ServerRescueNegativeTestJSON-660246268-project Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 734d44438bfb4a79a68aa6705e49b1e9 Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-660246268-project Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance edecb793-ad02-4b6f-addc-020ce872a118 could not be found. Aug 29 23:56:38.757922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'edecb793-ad02-4b6f-addc-020ce872a118'} Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edecb793-ad02-4b6f-addc-020ce872a118 could not be found. Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:38.759187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edecb793-ad02-4b6f-addc-020ce872a118 could not be found. Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edecb793-ad02-4b6f-addc-020ce872a118 could not be found. Aug 29 23:56:38.760643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:38.761963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] Returning 404 to user: Instance edecb793-ad02-4b6f-addc-020ce872a118 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:38.761963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-dd2eb3a6-5c69-42f3-905e-a11ec71299c2 tempest-ServerRescueNegativeTestJSON-660246268 tempest-ServerRescueNegativeTestJSON-660246268-project] 10.222.0.58 "GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118" status: 404 len: 111 microversion: 2.1 time: 0.031604 Aug 29 23:56:38.761963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 376/732] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:38 2022] GET /compute/v2.1/servers/edecb793-ad02-4b6f-addc-020ce872a118 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:56:38.766476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:38.776381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:38.798565 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:38.798565 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-94401cde-97ed-401c-811f-1d520c84df11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1406 microversion: 2.20 time: 0.476563 Aug 29 23:56:38.798565 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 357/733] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:38 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:38.986674 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-03ad38ac-73f9-431a-affe-72b73b247e09 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:38.989241 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-03ad38ac-73f9-431a-affe-72b73b247e09 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:38.996864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03ad38ac-73f9-431a-affe-72b73b247e09 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.997291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03ad38ac-73f9-431a-affe-72b73b247e09 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:38.997798 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03ad38ac-73f9-431a-affe-72b73b247e09 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:38.998809 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03ad38ac-73f9-431a-affe-72b73b247e09 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:38.999367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03ad38ac-73f9-431a-affe-72b73b247e09 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:39.000038 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-03ad38ac-73f9-431a-affe-72b73b247e09 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:39.032992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-03ad38ac-73f9-431a-affe-72b73b247e09 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050589 Aug 29 23:56:39.034011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 377/734] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:38 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:56:39.044957 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:39.045657 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:39.052745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:39.053302 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:39.056167 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:39.056167 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:39.056167 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:39.056167 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:39.141544 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] HTTP exception thrown: Instance 80567224-9d47-4087-b154-85564c2987cd is not attached to volume 974b8208-99fd-40b5-a9ca-af647057f0ae Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Request method failure captured: Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: DELETE /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments/974b8208-99fd-40b5-a9ca-af647057f0ae HTTP/1.1 Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVF0QtA9stKUMh_y4275jKDQBDIPRETxIq6z0vX2Nw_0351w85WRP73TGZVYMKoNkICV0vPU7HbbQWWLOFo5Q0OJYtU1osVh-w05PdaOiQWLwFsBt-XZBWyv9LZhJbZW0oFTcH3Nxv73-pWHTMHhRDJlNlA6ijOMIbS0vhZXe29G99o Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 2f665e85ae5b4008b60765fd3076a331 Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-TestMinimumBasicScenario-691207282 Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:56:39.151795 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f665e85ae5b4008b60765fd3076a331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f665e85ae5b4008b60765fd3076a331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f665e85ae5b4008b60765fd3076a331"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f665e85ae5b4008b60765fd3076a331", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-TestMinimumBasicScenario-691207282 Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 2f665e85ae5b4008b60765fd3076a331 Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-TestMinimumBasicScenario-691207282 Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-TestMinimumBasicScenario-691207282-project Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 27f78b50d76341e08e184582e8400a04 Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-TestMinimumBasicScenario-691207282-project Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:56:39.153288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 80567224-9d47-4087-b154-85564c2987cd is not attached to volume 974b8208-99fd-40b5-a9ca-af647057f0ae Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'server_id': '80567224-9d47-4087-b154-85564c2987cd', 'id': '974b8208-99fd-40b5-a9ca-af647057f0ae'} Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 974b8208-99fd-40b5-a9ca-af647057f0ae. Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:39.154041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80567224-9d47-4087-b154-85564c2987cd is not attached to volume 974b8208-99fd-40b5-a9ca-af647057f0ae Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80567224-9d47-4087-b154-85564c2987cd is not attached to volume 974b8208-99fd-40b5-a9ca-af647057f0ae Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:39.156010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Returning 404 to user: Instance 80567224-9d47-4087-b154-85564c2987cd is not attached to volume 974b8208-99fd-40b5-a9ca-af647057f0ae {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:39.156938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9235ce09-5a9f-4f4f-beb6-200ca8c04774 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "DELETE /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments/974b8208-99fd-40b5-a9ca-af647057f0ae" status: 404 len: 154 microversion: 2.1 time: 0.112621 Aug 29 23:56:39.156938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 358/735] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Aug 29 23:56:39 2022] DELETE /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd/os-volume_attachments/974b8208-99fd-40b5-a9ca-af647057f0ae => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:56:39.809187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:39.809841 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:39.816689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:39.817109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:39.817548 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:39.818244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:39.818722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:39.819452 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:39.972602 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:39.981880 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:39.983551 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:39.984917 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ba4ad2a6-76a7-4304-81b2-1c58f363d338 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1406 microversion: 2.20 time: 0.180101 Aug 29 23:56:39.985476 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 378/736] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:39 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:56:40.322125 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c3b855aa-ecfc-43a0-8810-d6a35e6cd7d7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:40.322914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c3b855aa-ecfc-43a0-8810-d6a35e6cd7d7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:40.328752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3b855aa-ecfc-43a0-8810-d6a35e6cd7d7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.329236 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3b855aa-ecfc-43a0-8810-d6a35e6cd7d7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.329664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3b855aa-ecfc-43a0-8810-d6a35e6cd7d7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.330411 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3b855aa-ecfc-43a0-8810-d6a35e6cd7d7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.331164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3b855aa-ecfc-43a0-8810-d6a35e6cd7d7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.331261 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c3b855aa-ecfc-43a0-8810-d6a35e6cd7d7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.357257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c3b855aa-ecfc-43a0-8810-d6a35e6cd7d7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/ips" status: 200 len: 148 microversion: 2.1 time: 0.155163 Aug 29 23:56:40.363815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 359/737] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Aug 29 23:56:40 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/ips => generated 148 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:40.437143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9e237bc3-333f-4ff8-b2f1-5218896f05f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:40.437940 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9e237bc3-333f-4ff8-b2f1-5218896f05f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:40.448891 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e237bc3-333f-4ff8-b2f1-5218896f05f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.449829 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e237bc3-333f-4ff8-b2f1-5218896f05f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.450967 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e237bc3-333f-4ff8-b2f1-5218896f05f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.452001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e237bc3-333f-4ff8-b2f1-5218896f05f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.452642 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e237bc3-333f-4ff8-b2f1-5218896f05f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.453989 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e237bc3-333f-4ff8-b2f1-5218896f05f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.458923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:40.483276 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9e237bc3-333f-4ff8-b2f1-5218896f05f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:56:40.793438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9e237bc3-333f-4ff8-b2f1-5218896f05f0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "DELETE /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 204 len: 0 microversion: 2.1 time: 0.364798 Aug 29 23:56:40.802530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 379/738] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:56:40 2022] DELETE /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:56:40.806976 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a98832f8-1f4b-4c51-8638-0385535b5247 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:40.807829 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a98832f8-1f4b-4c51-8638-0385535b5247 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:40.816444 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a98832f8-1f4b-4c51-8638-0385535b5247 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.817234 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a98832f8-1f4b-4c51-8638-0385535b5247 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.817927 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a98832f8-1f4b-4c51-8638-0385535b5247 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.818942 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a98832f8-1f4b-4c51-8638-0385535b5247 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.820552 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a98832f8-1f4b-4c51-8638-0385535b5247 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.821897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a98832f8-1f4b-4c51-8638-0385535b5247 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.901213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-71260e98-f75c-456b-829a-5df091daf352 req-c5255561-f891-4a61-a686-9b0c04359c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a5a820-1da2-47e6-b6e9-6586034c7fcf", "name": "network-vif-plugged", "status": "completed", "tag": "92bd74c9-1028-4a8d-a703-f5c8f8637fc5"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:40.916127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-71260e98-f75c-456b-829a-5df091daf352 req-c5255561-f891-4a61-a686-9b0c04359c25 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:40.916853 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-71260e98-f75c-456b-829a-5df091daf352 req-c5255561-f891-4a61-a686-9b0c04359c25 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:40.917575 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-71260e98-f75c-456b-829a-5df091daf352 req-c5255561-f891-4a61-a686-9b0c04359c25 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:40.930432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-71260e98-f75c-456b-829a-5df091daf352 req-c5255561-f891-4a61-a686-9b0c04359c25 service nova] Creating event network-vif-plugged:92bd74c9-1028-4a8d-a703-f5c8f8637fc5 for instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf on hv-cinder-85427 Aug 29 23:56:40.935626 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-71260e98-f75c-456b-829a-5df091daf352 req-c5255561-f891-4a61-a686-9b0c04359c25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040888 Aug 29 23:56:40.936922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 380/739] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:41.009179 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:41.010230 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:41.025113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:41.027190 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:41.027950 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:41.028942 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:41.029852 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:41.030642 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:41.163491 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a98832f8-1f4b-4c51-8638-0385535b5247 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:41.171317 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a98832f8-1f4b-4c51-8638-0385535b5247 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1554 microversion: 2.1 time: 0.370693 Aug 29 23:56:41.176077 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 360/740] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:40 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1554 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:41.337195 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:41.346387 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:41.347863 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:41.349066 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5fd906b0-9a50-46f2-aeae-6b91fb655422 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1406 microversion: 2.20 time: 0.344840 Aug 29 23:56:41.349616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 381/741] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:41 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:56:42.193803 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5bf1f95d-e267-4e72-80b1-1e11a7356de3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:42.196492 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5bf1f95d-e267-4e72-80b1-1e11a7356de3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:42.214807 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5bf1f95d-e267-4e72-80b1-1e11a7356de3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:42.215714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5bf1f95d-e267-4e72-80b1-1e11a7356de3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:42.216392 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5bf1f95d-e267-4e72-80b1-1e11a7356de3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:42.223083 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d70f0a4a-e593-458f-9a20-c301e5ea90cd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96ea48cf-c080-474f-baa2-0ac5bef4209d"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:42.225450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d70f0a4a-e593-458f-9a20-c301e5ea90cd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:42.228210 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5bf1f95d-e267-4e72-80b1-1e11a7356de3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:42.228681 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5bf1f95d-e267-4e72-80b1-1e11a7356de3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:42.229121 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5bf1f95d-e267-4e72-80b1-1e11a7356de3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:42.237979 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d70f0a4a-e593-458f-9a20-c301e5ea90cd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:42.238502 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d70f0a4a-e593-458f-9a20-c301e5ea90cd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:42.238942 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d70f0a4a-e593-458f-9a20-c301e5ea90cd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:42.241854 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d70f0a4a-e593-458f-9a20-c301e5ea90cd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:42.243353 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d70f0a4a-e593-458f-9a20-c301e5ea90cd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:42.246100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d70f0a4a-e593-458f-9a20-c301e5ea90cd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:42.542751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5bf1f95d-e267-4e72-80b1-1e11a7356de3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:42.554889 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5bf1f95d-e267-4e72-80b1-1e11a7356de3 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1554 microversion: 2.1 time: 0.364512 Aug 29 23:56:42.567586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 361/742] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:42 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1554 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:42.576001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:42.576610 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:42.582649 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:42.583127 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:42.583560 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:42.584290 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:42.584743 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:42.585379 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:42.733173 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:42.744325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:42.746661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:42.748355 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-fe7b9597-0e0a-4df5-8b07-68348384b216 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1406 microversion: 2.20 time: 0.179176 Aug 29 23:56:42.749185 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 362/743] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:42 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:43.409080 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d70f0a4a-e593-458f-9a20-c301e5ea90cd tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.188332 Aug 29 23:56:43.410242 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 382/744] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:56:42 2022] POST /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments => generated 194 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:43.580754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-30b1949f-8578-4d1e-908c-ed9a16d09fc0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:43.583245 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-30b1949f-8578-4d1e-908c-ed9a16d09fc0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:43.595823 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-30b1949f-8578-4d1e-908c-ed9a16d09fc0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:43.597011 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-30b1949f-8578-4d1e-908c-ed9a16d09fc0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:43.598021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-30b1949f-8578-4d1e-908c-ed9a16d09fc0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:43.599099 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-30b1949f-8578-4d1e-908c-ed9a16d09fc0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:43.599809 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-30b1949f-8578-4d1e-908c-ed9a16d09fc0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:43.600578 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-30b1949f-8578-4d1e-908c-ed9a16d09fc0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:43.784532 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:43.785237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:43.798095 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:43.798597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:43.799242 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:43.799963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:43.800486 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:43.800872 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:43.829152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-30b1949f-8578-4d1e-908c-ed9a16d09fc0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:43.847354 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-30b1949f-8578-4d1e-908c-ed9a16d09fc0 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1554 microversion: 2.1 time: 0.271318 Aug 29 23:56:43.849218 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 363/745] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:43 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1554 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:43.923352 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-b92c9fa1-f788-489c-aeb8-8c35e10c7805 req-95752928-ca9e-442b-a5f7-a4db73d67397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80567224-9d47-4087-b154-85564c2987cd", "name": "network-vif-deleted", "tag": "4bfeae22-1324-4d1f-9b5f-0d481c03c512"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:43.933442 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-b92c9fa1-f788-489c-aeb8-8c35e10c7805 req-95752928-ca9e-442b-a5f7-a4db73d67397 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:43.934231 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-b92c9fa1-f788-489c-aeb8-8c35e10c7805 req-95752928-ca9e-442b-a5f7-a4db73d67397 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:43.934688 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-b92c9fa1-f788-489c-aeb8-8c35e10c7805 req-95752928-ca9e-442b-a5f7-a4db73d67397 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:43.948303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-b92c9fa1-f788-489c-aeb8-8c35e10c7805 req-95752928-ca9e-442b-a5f7-a4db73d67397 service nova] Creating event network-vif-deleted:4bfeae22-1324-4d1f-9b5f-0d481c03c512 for instance 80567224-9d47-4087-b154-85564c2987cd on hv-cinder-85427 Aug 29 23:56:43.953570 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-b92c9fa1-f788-489c-aeb8-8c35e10c7805 req-95752928-ca9e-442b-a5f7-a4db73d67397 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034587 Aug 29 23:56:43.954485 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 364/746] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:44.009421 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:44.024249 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:44.025910 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:44.036415 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a8df32b8-2689-4aec-8d99-3573d04de1f1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1406 microversion: 2.20 time: 0.256034 Aug 29 23:56:44.037286 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 383/747] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:43 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:44.872861 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:44.873716 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:44.880276 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:44.880752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:44.881180 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:44.882075 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:44.882559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:44.883107 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:44.919358 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:44.919856 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:44.920290 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:44.920742 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lazy-loading 'fault' on Instance uuid 80567224-9d47-4087-b154-85564c2987cd {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:44.982610 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f78b50d76341e08e184582e8400a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f665e85ae5b4008b60765fd3076a331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:44.984042 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9503e991-00ff-41ae-a32a-8b72418c3148 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 200 len: 1348 microversion: 2.1 time: 0.117060 Aug 29 23:56:44.984042 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 365/748] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:44 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 1348 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:45.061079 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:45.062503 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:45.069708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.070355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.071226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.072067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.072524 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.072945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.228228 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:45.236869 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:45.238319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:45.239510 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6cfc7642-2987-47c3-825e-737c240aa5b8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1597 microversion: 2.20 time: 0.183347 Aug 29 23:56:45.240061 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 384/749] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:56:45 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1597 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:56:45.262678 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-548d88e5-bb2e-4a68-bbb0-fb5ce3fd16fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:45.263180 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-548d88e5-bb2e-4a68-bbb0-fb5ce3fd16fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:45.269293 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-548d88e5-bb2e-4a68-bbb0-fb5ce3fd16fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.269775 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-548d88e5-bb2e-4a68-bbb0-fb5ce3fd16fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.270207 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-548d88e5-bb2e-4a68-bbb0-fb5ce3fd16fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.270931 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-548d88e5-bb2e-4a68-bbb0-fb5ce3fd16fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:45.272045 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-548d88e5-bb2e-4a68-bbb0-fb5ce3fd16fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:45.272045 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-548d88e5-bb2e-4a68-bbb0-fb5ce3fd16fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:45.384507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-548d88e5-bb2e-4a68-bbb0-fb5ce3fd16fe tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.126006 Aug 29 23:56:45.385107 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 366/750] 10.222.0.58 () {60 vars in 1316 bytes} [Mon Aug 29 23:56:45 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:56:46.014660 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:46.015720 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] [instance: 80567224-9d47-4087-b154-85564c2987cd] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:46.027438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:46.028309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:46.028803 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:46.029645 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:46.030204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:46.030782 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:46.049234 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] HTTP exception thrown: Instance 80567224-9d47-4087-b154-85564c2987cd could not be found. Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Request method failure captured: Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd HTTP/1.1 Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVF0QtA9stKUMh_y4275jKDQBDIPRETxIq6z0vX2Nw_0351w85WRP73TGZVYMKoNkICV0vPU7HbbQWWLOFo5Q0OJYtU1osVh-w05PdaOiQWLwFsBt-XZBWyv9LZhJbZW0oFTcH3Nxv73-pWHTMHhRDJlNlA6ijOMIbS0vhZXe29G99o Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 2f665e85ae5b4008b60765fd3076a331 Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-TestMinimumBasicScenario-691207282 Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:56:46.051201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f665e85ae5b4008b60765fd3076a331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f665e85ae5b4008b60765fd3076a331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f665e85ae5b4008b60765fd3076a331"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f665e85ae5b4008b60765fd3076a331", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-TestMinimumBasicScenario-691207282 Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 2f665e85ae5b4008b60765fd3076a331 Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-TestMinimumBasicScenario-691207282 Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-TestMinimumBasicScenario-691207282-project Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 27f78b50d76341e08e184582e8400a04 Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-TestMinimumBasicScenario-691207282-project Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 80567224-9d47-4087-b154-85564c2987cd could not be found. Aug 29 23:56:46.052866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '80567224-9d47-4087-b154-85564c2987cd'} Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80567224-9d47-4087-b154-85564c2987cd could not be found. Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:46.053811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80567224-9d47-4087-b154-85564c2987cd could not be found. Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80567224-9d47-4087-b154-85564c2987cd could not be found. Aug 29 23:56:46.055596 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:46.056866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Returning 404 to user: Instance 80567224-9d47-4087-b154-85564c2987cd could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:46.056866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-608be48d-8b87-4ac4-ab0f-6c7a73d56db2 tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd" status: 404 len: 111 microversion: 2.1 time: 0.051191 Aug 29 23:56:46.056866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 385/751] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:46 2022] GET /compute/v2.1/servers/80567224-9d47-4087-b154-85564c2987cd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:56:46.065327 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4e316025-1ad9-486a-bcc5-bc42a8db249a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] Calling method '.version_select at 0x7fabbdcd4700>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:46.174639 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4e316025-1ad9-486a-bcc5-bc42a8db249a tempest-TestMinimumBasicScenario-691207282 tempest-TestMinimumBasicScenario-691207282-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1653362230" status: 202 len: 0 microversion: 2.1 time: 0.113984 Aug 29 23:56:46.175589 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 386/752] 10.222.0.58 () {58 vars in 1272 bytes} [Mon Aug 29 23:56:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1653362230 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:56:46.200385 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-08f40ae3-d08b-498f-9dc5-a5b24cdaa1e6 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] Action: 'create', calling method: .version_select at 0x7fabbdb65ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1372004155", "metadata": {"Type": "work"}}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:46.842887 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-fce3c66c-da20-4b5e-a57f-46be5dbd3dda req-e86a4fc8-91bc-4006-961b-14ae9e86cb48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a5a820-1da2-47e6-b6e9-6586034c7fcf", "tag": "92bd74c9-1028-4a8d-a703-f5c8f8637fc5"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:46.851911 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-fce3c66c-da20-4b5e-a57f-46be5dbd3dda req-e86a4fc8-91bc-4006-961b-14ae9e86cb48 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:46.852412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-fce3c66c-da20-4b5e-a57f-46be5dbd3dda req-e86a4fc8-91bc-4006-961b-14ae9e86cb48 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:46.852940 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-fce3c66c-da20-4b5e-a57f-46be5dbd3dda req-e86a4fc8-91bc-4006-961b-14ae9e86cb48 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:46.865249 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-fce3c66c-da20-4b5e-a57f-46be5dbd3dda req-e86a4fc8-91bc-4006-961b-14ae9e86cb48 service nova] Creating event network-changed:92bd74c9-1028-4a8d-a703-f5c8f8637fc5 for instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf on hv-cinder-85427 Aug 29 23:56:46.871806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-fce3c66c-da20-4b5e-a57f-46be5dbd3dda req-e86a4fc8-91bc-4006-961b-14ae9e86cb48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037637 Aug 29 23:56:46.872858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 387/753] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:47.063710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-08f40ae3-d08b-498f-9dc5-a5b24cdaa1e6 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.035120 Aug 29 23:56:47.064792 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 367/754] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Aug 29 23:56:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1037 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 23:56:47.078748 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f1e9bd7d-1534-4194-9528-8e6899496ea3 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] Calling method '.version_select at 0x7fabbdd96700>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:47.179623 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f1e9bd7d-1534-4194-9528-8e6899496ea3 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719" status: 200 len: 353 microversion: 2.1 time: 0.105565 Aug 29 23:56:47.180653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 388/755] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:56:47 2022] GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:48.197332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9f77218d-756f-423f-a65c-36c413953daa tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] Calling method '.version_select at 0x7fabbdc2c670>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:48.256447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9f77218d-756f-423f-a65c-36c413953daa tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719" status: 200 len: 354 microversion: 2.1 time: 0.061879 Aug 29 23:56:48.256447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 368/756] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:56:48 2022] GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:48.268835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-14ce74c7-de98-4eec-a9d3-61717ab58f75 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] Calling method '.version_select at 0x7fabbdd6e5e0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:48.328204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-14ce74c7-de98-4eec-a9d3-61717ab58f75 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719" status: 200 len: 354 microversion: 2.1 time: 0.063911 Aug 29 23:56:48.329129 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 389/757] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:56:48 2022] GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719 => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:48.348611 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5dd462cd-e25c-4f96-959f-fe3721eb6a2d tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] Calling method '.version_select at 0x7fabbdb6faf0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:48.620414 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5dd462cd-e25c-4f96-959f-fe3721eb6a2d tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719" status: 202 len: 0 microversion: 2.1 time: 0.275735 Aug 29 23:56:48.621256 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 369/758] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Aug 29 23:56:48 2022] DELETE /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:56:48.629619 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2efc8542-527c-4841-85b6-1b7536d4c555 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] Calling method '.version_select at 0x7fabbec04430>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:48.679525 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2efc8542-527c-4841-85b6-1b7536d4c555 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719" status: 200 len: 353 microversion: 2.1 time: 0.053576 Aug 29 23:56:48.680096 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 390/759] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:56:48 2022] GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:49.693832 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-80829943-dcba-412f-a4cb-5e76bf241947 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] Calling method '.version_select at 0x7fabbdc3aaf0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:49.726250 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-80829943-dcba-412f-a4cb-5e76bf241947 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] HTTP exception thrown: Volume a14ed035-e990-4691-b7ed-d3729c1db719 could not be found. Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-80829943-dcba-412f-a4cb-5e76bf241947 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] Request method failure captured: Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719 HTTP/1.1 Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVI9xYJdy_gk2NURjWszUyopJr0XW5rDpnOQYxbJB964aLha5GeHd4DNQ7pyFJhcub813ApR5ZqvUcoY2iyyOprQWdCI36s3WRA5O49yN6jCw6ZWBbIKVWn5u-Lvu0YSbKjt1-_XCI_pvLdpGTOhf46qdYcWRwkeTq8bHSV08dufvcY Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 1b0e837d11f9456fa947f14dd0499947 Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-VolumesGetTestJSON-142258698 Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:56:49.728429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1b0e837d11f9456fa947f14dd0499947"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1b0e837d11f9456fa947f14dd0499947"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1b0e837d11f9456fa947f14dd0499947"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1b0e837d11f9456fa947f14dd0499947", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-VolumesGetTestJSON-142258698 Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 1b0e837d11f9456fa947f14dd0499947 Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-VolumesGetTestJSON-142258698 Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-VolumesGetTestJSON-142258698-project Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 809a613eab10447ca8a8cf3aa87d9820 Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-VolumesGetTestJSON-142258698-project Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Volume a14ed035-e990-4691-b7ed-d3729c1db719 could not be found. Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': 'a14ed035-e990-4691-b7ed-d3729c1db719'} Aug 29 23:56:49.730119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a14ed035-e990-4691-b7ed-d3729c1db719 could not be found. (HTTP 404) (Request-ID: req-02bf8f49-c4a1-4bef-9605-8c7df633aeff) Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:49.731038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:56:49.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a14ed035-e990-4691-b7ed-d3729c1db719 could not be found. Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 23:56:49.733421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a14ed035-e990-4691-b7ed-d3729c1db719 could not be found. Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a14ed035-e990-4691-b7ed-d3729c1db719 could not be found. Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-80829943-dcba-412f-a4cb-5e76bf241947 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] Returning 404 to user: Volume a14ed035-e990-4691-b7ed-d3729c1db719 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-80829943-dcba-412f-a4cb-5e76bf241947 tempest-VolumesGetTestJSON-142258698 tempest-VolumesGetTestJSON-142258698-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719" status: 404 len: 109 microversion: 2.1 time: 0.040639 Aug 29 23:56:49.737898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 370/760] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:56:49 2022] GET /compute/v2.1/os-volumes/a14ed035-e990-4691-b7ed-d3729c1db719 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:56:52.198861 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96ea48cf-c080-474f-baa2-0ac5bef4209d"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:52.206195 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:52.222884 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.224145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.226559 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.228300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.229506 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.231122 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.355305 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Invalid volume: volume 96ea48cf-c080-474f-baa2-0ac5bef4209d is already attached to instances: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: POST /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments HTTP/1.1 Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 74 Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:56:52.360658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {"volumeAttachment": {"volumeId": "96ea48cf-c080-474f-baa2-0ac5bef4209d"}} Aug 29 23:56:52.368438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Invalid volume: volume 96ea48cf-c080-474f-baa2-0ac5bef4209d is already attached to instances: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'server_id': '03f0e15f-3470-4cba-a00a-4f282d3ddfd3', 'body': {'volumeAttachment': {'volumeId': '96ea48cf-c080-474f-baa2-0ac5bef4209d'}}} Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 96ea48cf-c080-474f-baa2-0ac5bef4209d is already attached to instances: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:52.369210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 96ea48cf-c080-474f-baa2-0ac5bef4209d is already attached to instances: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:52.371158 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:52.376616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:52.376616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:52.376616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:52.376616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 96ea48cf-c080-474f-baa2-0ac5bef4209d is already attached to instances: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 Aug 29 23:56:52.376616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:56:52.376616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 400 to user: Invalid volume: volume 96ea48cf-c080-474f-baa2-0ac5bef4209d is already attached to instances: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:52.376616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-889a63dd-66ea-47ab-89e6-90cbf9ae3965 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.174673 Aug 29 23:56:52.376616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 391/761] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:56:52 2022] POST /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments => generated 174 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:56:52.521621 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4078002d-8ca1-4f87-8c0a-5a807b4a9e79 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:52.524403 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4078002d-8ca1-4f87-8c0a-5a807b4a9e79 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:52.536647 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4078002d-8ca1-4f87-8c0a-5a807b4a9e79 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.537248 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4078002d-8ca1-4f87-8c0a-5a807b4a9e79 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.539464 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4078002d-8ca1-4f87-8c0a-5a807b4a9e79 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.540020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4078002d-8ca1-4f87-8c0a-5a807b4a9e79 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:52.540788 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4078002d-8ca1-4f87-8c0a-5a807b4a9e79 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:52.541945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4078002d-8ca1-4f87-8c0a-5a807b4a9e79 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:52.682226 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-4078002d-8ca1-4f87-8c0a-5a807b4a9e79 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lazy-loading 'services' on Instance uuid 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:53.036856 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4078002d-8ca1-4f87-8c0a-5a807b4a9e79 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments/96ea48cf-c080-474f-baa2-0ac5bef4209d" status: 202 len: 0 microversion: 2.1 time: 0.523844 Aug 29 23:56:53.039515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 371/762] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Aug 29 23:56:52 2022] DELETE /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments/96ea48cf-c080-474f-baa2-0ac5bef4209d => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:56:53.050001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-04552f6e-bdff-47be-9362-af284a7e22b7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:53.052591 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-04552f6e-bdff-47be-9362-af284a7e22b7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:53.061702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-04552f6e-bdff-47be-9362-af284a7e22b7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.062244 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-04552f6e-bdff-47be-9362-af284a7e22b7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.062722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-04552f6e-bdff-47be-9362-af284a7e22b7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.063482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-04552f6e-bdff-47be-9362-af284a7e22b7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:53.063935 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-04552f6e-bdff-47be-9362-af284a7e22b7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:53.064357 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-04552f6e-bdff-47be-9362-af284a7e22b7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:53.098398 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-04552f6e-bdff-47be-9362-af284a7e22b7 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053335 Aug 29 23:56:53.098946 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 392/763] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:53 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:54.114529 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2251ce85-ce9d-4e1a-96c5-b86a8a16acf1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:54.117732 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2251ce85-ce9d-4e1a-96c5-b86a8a16acf1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:54.125332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2251ce85-ce9d-4e1a-96c5-b86a8a16acf1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:54.126338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2251ce85-ce9d-4e1a-96c5-b86a8a16acf1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:54.126994 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2251ce85-ce9d-4e1a-96c5-b86a8a16acf1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:54.127886 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2251ce85-ce9d-4e1a-96c5-b86a8a16acf1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:54.130745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2251ce85-ce9d-4e1a-96c5-b86a8a16acf1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:54.131896 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2251ce85-ce9d-4e1a-96c5-b86a8a16acf1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:54.187297 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2251ce85-ce9d-4e1a-96c5-b86a8a16acf1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078391 Aug 29 23:56:54.188254 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 372/764] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:56:54 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:56:54.265445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dd191195-8153-4054-9f5b-b2c3bd33d82d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:54.266247 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-dd191195-8153-4054-9f5b-b2c3bd33d82d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:54.273613 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd191195-8153-4054-9f5b-b2c3bd33d82d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:54.274462 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd191195-8153-4054-9f5b-b2c3bd33d82d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:54.275058 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd191195-8153-4054-9f5b-b2c3bd33d82d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:54.275958 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd191195-8153-4054-9f5b-b2c3bd33d82d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:54.276681 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd191195-8153-4054-9f5b-b2c3bd33d82d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:54.277294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dd191195-8153-4054-9f5b-b2c3bd33d82d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:54.304857 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-dd191195-8153-4054-9f5b-b2c3bd33d82d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:56:54.684694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-dd191195-8153-4054-9f5b-b2c3bd33d82d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 204 len: 0 microversion: 2.1 time: 0.422369 Aug 29 23:56:54.699282 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 393/765] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:56:54 2022] DELETE /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:56:54.717343 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-85a73fcc-dc05-4617-9b8d-c3fc728564a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:54.727430 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-85a73fcc-dc05-4617-9b8d-c3fc728564a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:54.745212 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-85a73fcc-dc05-4617-9b8d-c3fc728564a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:54.745906 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-85a73fcc-dc05-4617-9b8d-c3fc728564a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:54.746596 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-85a73fcc-dc05-4617-9b8d-c3fc728564a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:54.747539 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-85a73fcc-dc05-4617-9b8d-c3fc728564a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:54.748148 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-85a73fcc-dc05-4617-9b8d-c3fc728564a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:54.748624 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-85a73fcc-dc05-4617-9b8d-c3fc728564a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:54.928096 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-85a73fcc-dc05-4617-9b8d-c3fc728564a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:54.941130 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-85a73fcc-dc05-4617-9b8d-c3fc728564a3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1680 microversion: 2.1 time: 0.239412 Aug 29 23:56:54.942232 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 373/766] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:54 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:55.979954 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-eb45511c-4e22-4562-a923-c55409acc89c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:55.981017 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-eb45511c-4e22-4562-a923-c55409acc89c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:55.988060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb45511c-4e22-4562-a923-c55409acc89c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:55.990722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb45511c-4e22-4562-a923-c55409acc89c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:55.990722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb45511c-4e22-4562-a923-c55409acc89c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:55.991372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb45511c-4e22-4562-a923-c55409acc89c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:55.992326 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb45511c-4e22-4562-a923-c55409acc89c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:55.993226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-eb45511c-4e22-4562-a923-c55409acc89c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:56.186368 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-eb45511c-4e22-4562-a923-c55409acc89c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:56.202978 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-eb45511c-4e22-4562-a923-c55409acc89c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1680 microversion: 2.1 time: 0.228175 Aug 29 23:56:56.204283 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 394/767] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:55 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:57.227077 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c60a9fe3-153d-4b53-b681-eeb86f66da88 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:57.231660 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c60a9fe3-153d-4b53-b681-eeb86f66da88 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:57.234902 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c60a9fe3-153d-4b53-b681-eeb86f66da88 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:57.242702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c60a9fe3-153d-4b53-b681-eeb86f66da88 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:57.243527 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c60a9fe3-153d-4b53-b681-eeb86f66da88 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:57.244496 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c60a9fe3-153d-4b53-b681-eeb86f66da88 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:57.245175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c60a9fe3-153d-4b53-b681-eeb86f66da88 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:57.245835 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c60a9fe3-153d-4b53-b681-eeb86f66da88 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:57.355149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c60a9fe3-153d-4b53-b681-eeb86f66da88 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:57.367827 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c60a9fe3-153d-4b53-b681-eeb86f66da88 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1613 microversion: 2.1 time: 0.144535 Aug 29 23:56:57.368523 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 374/768] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:57 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1613 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:56:57.601759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-708f5b79-a1b3-4f30-9735-cc30a248579d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:57.602602 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-708f5b79-a1b3-4f30-9735-cc30a248579d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:57.609375 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-708f5b79-a1b3-4f30-9735-cc30a248579d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:57.610059 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-708f5b79-a1b3-4f30-9735-cc30a248579d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:57.610794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-708f5b79-a1b3-4f30-9735-cc30a248579d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:57.613797 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-708f5b79-a1b3-4f30-9735-cc30a248579d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:57.614629 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-708f5b79-a1b3-4f30-9735-cc30a248579d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:57.615212 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-708f5b79-a1b3-4f30-9735-cc30a248579d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:57.644924 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-708f5b79-a1b3-4f30-9735-cc30a248579d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/ips" status: 200 len: 145 microversion: 2.1 time: 0.051776 Aug 29 23:56:57.651154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 375/769] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Aug 29 23:56:57 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:56:57.777416 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-fcbe0f3d-9852-4669-ad78-9176c9ccf21a req-01da0543-263c-4ff5-9159-f67a4c2ac422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f0e15f-3470-4cba-a00a-4f282d3ddfd3", "name": "network-vif-deleted", "tag": "d541c48e-12a3-458e-89b2-d84241d30d87"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:57.797237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-fcbe0f3d-9852-4669-ad78-9176c9ccf21a req-01da0543-263c-4ff5-9159-f67a4c2ac422 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:57.801086 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-fcbe0f3d-9852-4669-ad78-9176c9ccf21a req-01da0543-263c-4ff5-9159-f67a4c2ac422 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:57.803496 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-fcbe0f3d-9852-4669-ad78-9176c9ccf21a req-01da0543-263c-4ff5-9159-f67a4c2ac422 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:57.828018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-fcbe0f3d-9852-4669-ad78-9176c9ccf21a req-01da0543-263c-4ff5-9159-f67a4c2ac422 service nova] Creating event network-vif-deleted:d541c48e-12a3-458e-89b2-d84241d30d87 for instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 on hv-cinder-85427 Aug 29 23:56:57.840351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-fcbe0f3d-9852-4669-ad78-9176c9ccf21a req-01da0543-263c-4ff5-9159-f67a4c2ac422 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286081 Aug 29 23:56:57.840992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 395/770] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:56:58.396026 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:58.397926 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:58.408436 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:58.409430 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:58.410345 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:58.411770 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:58.412529 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:58.413243 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:58.491742 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:58.492425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:58.493943 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:58.494551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lazy-loading 'fault' on Instance uuid 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:56:58.547658 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:56:58.559658 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-36c8c4ec-9098-42ed-b0c3-d05e87bf6ded tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 200 len: 1332 microversion: 2.1 time: 0.170012 Aug 29 23:56:58.560411 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 376/771] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:58 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 1332 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:56:59.577548 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c42b69a0-d70a-4c42-9843-ae3a7369b04e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35a4e4b7-b039-4741-878d-4b81f94a99d6"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:56:59.580006 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c42b69a0-d70a-4c42-9843-ae3a7369b04e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:59.587797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c42b69a0-d70a-4c42-9843-ae3a7369b04e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:59.588472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c42b69a0-d70a-4c42-9843-ae3a7369b04e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:59.588914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c42b69a0-d70a-4c42-9843-ae3a7369b04e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:59.589648 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c42b69a0-d70a-4c42-9843-ae3a7369b04e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:59.590092 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:59.590583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c42b69a0-d70a-4c42-9843-ae3a7369b04e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:59.590583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c42b69a0-d70a-4c42-9843-ae3a7369b04e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:59.590766 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:56:59.597039 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:59.597511 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:59.599155 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:59.599155 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:56:59.599155 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:56:59.599481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:56:59.602270 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:56:59.614064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 HTTP/1.1 Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:56:59.618291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:56:59.623314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '03f0e15f-3470-4cba-a00a-4f282d3ddfd3'} Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:56:59.624171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:56:59.625590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:56:59.627926 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:56:59.627926 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4ecaad3b-e53e-486b-938d-b947955a5996 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 404 len: 111 microversion: 2.1 time: 0.033720 Aug 29 23:56:59.627926 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 377/772] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:56:59 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:56:59.628529 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fa10af76-e024-4e38-a780-204c5b07b64d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '.version_select at 0x7fabbdc2c790>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:56:59.746180 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-fa10af76-e024-4e38-a780-204c5b07b64d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057048236" status: 202 len: 0 microversion: 2.1 time: 0.121290 Aug 29 23:56:59.746899 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 378/773] 10.222.0.58 () {58 vars in 1221 bytes} [Mon Aug 29 23:56:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057048236 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:57:00.296922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:00.472011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c42b69a0-d70a-4c42-9843-ae3a7369b04e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.898214 Aug 29 23:57:00.473381 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 396/774] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:56:59 2022] POST /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments => generated 194 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:01.156618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8f00cdd5-8145-4405-8e5d-ddd3df8a9a77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: .version_select at 0x7fabbdb6f820>, body: {"keypair": {"name": "tempest-keypair-1270248252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOOzdjKHqYXXjFy7Xqi5wRTJ5U4wkkdeucmPXLvI0R4TTHw42wYYnz2ucxQA2Vy7uHmGooJKTwB2daZ9cEPQV4J4tS8w9DpIyP6gC0z2TD67kW1mGLCBmND4hWD8quqhw=="}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:01.176110 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-8f00cdd5-8145-4405-8e5d-ddd3df8a9a77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:57:01.181691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-8f00cdd5-8145-4405-8e5d-ddd3df8a9a77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for user 34ef7ee27c3948ac9df1ff94ce24618e and project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:57:01.330648 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8f00cdd5-8145-4405-8e5d-ddd3df8a9a77 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179903 Aug 29 23:57:01.332285 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 379/775] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Aug 29 23:57:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:04.043028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2126980426", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b596b2d-12e3-47f4-a595-eed3b3358a18"}], "security_groups": [{"name": "tempest-securitygroup--1579315483"}], "key_name": "tempest-keypair-1270248252", "user_data": "}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:04.051570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:04.153950 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] validate_networks() for [('9b596b2d-12e3-47f4-a595-eed3b3358a18', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:57:04.683351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:57:04.683814 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:57:04.684372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:57:04.684819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:57:04.685379 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:57:04.694805 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:04.695369 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:04.695717 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:04.696441 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:04.696890 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:04.697303 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:04.714608 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:57:04.719182 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Getting quotas for user 34ef7ee27c3948ac9df1ff94ce24618e and project 80d82515633f4c2faa34d3225a6f26a6. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:57:04.735861 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:57:04.735861 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:57:04.942289 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fff94a88-bf8c-4d46-949b-30410ebad984 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.904874 Aug 29 23:57:04.943110 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 397/776] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:57:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:57:04.954771 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-386b7cf4-bc5d-4e8b-b713-b493f3f734cb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:04.955385 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-386b7cf4-bc5d-4e8b-b713-b493f3f734cb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:04.957718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:05.029109 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-386b7cf4-bc5d-4e8b-b713-b493f3f734cb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:05.036316 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-386b7cf4-bc5d-4e8b-b713-b493f3f734cb tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1242 microversion: 2.1 time: 0.085799 Aug 29 23:57:05.036927 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 380/777] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:04 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:06.057821 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-22eb3fc6-d4c1-49bf-bfc2-6fadf960710c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:06.058447 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-22eb3fc6-d4c1-49bf-bfc2-6fadf960710c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:06.065568 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22eb3fc6-d4c1-49bf-bfc2-6fadf960710c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:06.065978 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22eb3fc6-d4c1-49bf-bfc2-6fadf960710c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:06.066412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22eb3fc6-d4c1-49bf-bfc2-6fadf960710c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:06.067129 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22eb3fc6-d4c1-49bf-bfc2-6fadf960710c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:06.067708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22eb3fc6-d4c1-49bf-bfc2-6fadf960710c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:06.068051 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22eb3fc6-d4c1-49bf-bfc2-6fadf960710c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:06.140278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-22eb3fc6-d4c1-49bf-bfc2-6fadf960710c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:06.149491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-22eb3fc6-d4c1-49bf-bfc2-6fadf960710c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1246 microversion: 2.1 time: 0.096121 Aug 29 23:57:06.150252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 398/778] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:06 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:07.171695 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c7fcfcae-966a-4c75-88a7-afbed70db834 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:07.172298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c7fcfcae-966a-4c75-88a7-afbed70db834 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:07.180082 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7fcfcae-966a-4c75-88a7-afbed70db834 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:07.180928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7fcfcae-966a-4c75-88a7-afbed70db834 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:07.181371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7fcfcae-966a-4c75-88a7-afbed70db834 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:07.182069 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7fcfcae-966a-4c75-88a7-afbed70db834 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:07.182577 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7fcfcae-966a-4c75-88a7-afbed70db834 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:07.183002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c7fcfcae-966a-4c75-88a7-afbed70db834 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:07.252798 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c7fcfcae-966a-4c75-88a7-afbed70db834 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:07.263149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c7fcfcae-966a-4c75-88a7-afbed70db834 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1294 microversion: 2.1 time: 0.095283 Aug 29 23:57:07.264103 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 381/779] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:07 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:08.294771 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a3da041c-b2b6-4038-b17f-f0bb41b2f23b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:08.296059 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a3da041c-b2b6-4038-b17f-f0bb41b2f23b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:08.307351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a3da041c-b2b6-4038-b17f-f0bb41b2f23b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:08.313463 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a3da041c-b2b6-4038-b17f-f0bb41b2f23b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:08.316933 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a3da041c-b2b6-4038-b17f-f0bb41b2f23b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:08.321512 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a3da041c-b2b6-4038-b17f-f0bb41b2f23b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:08.322787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a3da041c-b2b6-4038-b17f-f0bb41b2f23b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:08.325892 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a3da041c-b2b6-4038-b17f-f0bb41b2f23b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:08.549157 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a3da041c-b2b6-4038-b17f-f0bb41b2f23b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:08.571794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a3da041c-b2b6-4038-b17f-f0bb41b2f23b tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1302 microversion: 2.1 time: 0.285725 Aug 29 23:57:08.573767 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 399/780] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:08 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1302 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:09.226739 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c29c18bf-7d8c-47dc-80c3-5f0c8c348d29 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:09.228793 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c29c18bf-7d8c-47dc-80c3-5f0c8c348d29 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:09.236671 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c29c18bf-7d8c-47dc-80c3-5f0c8c348d29 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:09.237300 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c29c18bf-7d8c-47dc-80c3-5f0c8c348d29 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:09.237796 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c29c18bf-7d8c-47dc-80c3-5f0c8c348d29 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:09.238567 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c29c18bf-7d8c-47dc-80c3-5f0c8c348d29 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:09.239023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c29c18bf-7d8c-47dc-80c3-5f0c8c348d29 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:09.239451 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c29c18bf-7d8c-47dc-80c3-5f0c8c348d29 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:09.272261 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c29c18bf-7d8c-47dc-80c3-5f0c8c348d29 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052352 Aug 29 23:57:09.272903 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 382/781] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:09 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:09.284191 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5e5f5259-95ce-4daa-91a3-2e34b4b7bc32 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:09.284684 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-5e5f5259-95ce-4daa-91a3-2e34b4b7bc32 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:09.291851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5e5f5259-95ce-4daa-91a3-2e34b4b7bc32 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:09.292340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5e5f5259-95ce-4daa-91a3-2e34b4b7bc32 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:09.292773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5e5f5259-95ce-4daa-91a3-2e34b4b7bc32 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:09.293482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5e5f5259-95ce-4daa-91a3-2e34b4b7bc32 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:09.293933 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5e5f5259-95ce-4daa-91a3-2e34b4b7bc32 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:09.294358 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5e5f5259-95ce-4daa-91a3-2e34b4b7bc32 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:09.331185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5e5f5259-95ce-4daa-91a3-2e34b4b7bc32 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments/35a4e4b7-b039-4741-878d-4b81f94a99d6" status: 200 len: 194 microversion: 2.1 time: 0.050788 Aug 29 23:57:09.337221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 400/782] 10.222.0.58 () {58 vars in 1413 bytes} [Mon Aug 29 23:57:09 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments/35a4e4b7-b039-4741-878d-4b81f94a99d6 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:09.600879 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f9d73b9f-629b-4ec4-9004-dc9ec19bebae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:09.607058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f9d73b9f-629b-4ec4-9004-dc9ec19bebae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:09.611510 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9d73b9f-629b-4ec4-9004-dc9ec19bebae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:09.612703 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9d73b9f-629b-4ec4-9004-dc9ec19bebae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:09.613451 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9d73b9f-629b-4ec4-9004-dc9ec19bebae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:09.614512 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9d73b9f-629b-4ec4-9004-dc9ec19bebae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:09.615146 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9d73b9f-629b-4ec4-9004-dc9ec19bebae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:09.615986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f9d73b9f-629b-4ec4-9004-dc9ec19bebae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:09.813944 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f9d73b9f-629b-4ec4-9004-dc9ec19bebae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:09.823109 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f9d73b9f-629b-4ec4-9004-dc9ec19bebae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1368 microversion: 2.1 time: 0.231709 Aug 29 23:57:09.835972 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 383/783] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:09 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:10.745116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-5390a56d-6c68-4370-8435-66c0b235c3f4 req-915a38b5-dc13-4910-b250-26e4a327744d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a4eed7-3b9b-45e9-9a5f-e022b5e59825", "tag": "d3c7c9a6-8c48-452c-bdc9-84311c5e0ebb"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:10.755915 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-5390a56d-6c68-4370-8435-66c0b235c3f4 req-915a38b5-dc13-4910-b250-26e4a327744d service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:10.756539 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-5390a56d-6c68-4370-8435-66c0b235c3f4 req-915a38b5-dc13-4910-b250-26e4a327744d service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:10.757065 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-5390a56d-6c68-4370-8435-66c0b235c3f4 req-915a38b5-dc13-4910-b250-26e4a327744d service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:10.768811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-5390a56d-6c68-4370-8435-66c0b235c3f4 req-915a38b5-dc13-4910-b250-26e4a327744d service nova] Creating event network-changed:d3c7c9a6-8c48-452c-bdc9-84311c5e0ebb for instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 on hv-cinder-85427 Aug 29 23:57:10.773999 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-5390a56d-6c68-4370-8435-66c0b235c3f4 req-915a38b5-dc13-4910-b250-26e4a327744d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033416 Aug 29 23:57:10.774668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 401/784] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:10.846580 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f4a3c94a-9378-48d4-9662-eb2120dfd964 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:10.847192 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f4a3c94a-9378-48d4-9662-eb2120dfd964 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:10.855885 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4a3c94a-9378-48d4-9662-eb2120dfd964 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:10.856479 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4a3c94a-9378-48d4-9662-eb2120dfd964 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:10.856941 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4a3c94a-9378-48d4-9662-eb2120dfd964 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:10.857686 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4a3c94a-9378-48d4-9662-eb2120dfd964 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:10.858229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4a3c94a-9378-48d4-9662-eb2120dfd964 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:10.858788 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4a3c94a-9378-48d4-9662-eb2120dfd964 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.108675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d8c28fd4-b8f9-4ad3-baec-def0f364d0cf tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cab5702d-3cc3-4449-b7a5-4a1c4964f5f8"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:11.111131 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d8c28fd4-b8f9-4ad3-baec-def0f364d0cf tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:11.118242 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d8c28fd4-b8f9-4ad3-baec-def0f364d0cf tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:11.118776 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d8c28fd4-b8f9-4ad3-baec-def0f364d0cf tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:11.119204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d8c28fd4-b8f9-4ad3-baec-def0f364d0cf tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.121101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d8c28fd4-b8f9-4ad3-baec-def0f364d0cf tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:11.121101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d8c28fd4-b8f9-4ad3-baec-def0f364d0cf tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:11.121101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d8c28fd4-b8f9-4ad3-baec-def0f364d0cf tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:11.122938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f4a3c94a-9378-48d4-9662-eb2120dfd964 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:11.146466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f4a3c94a-9378-48d4-9662-eb2120dfd964 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1368 microversion: 2.1 time: 0.292381 Aug 29 23:57:11.146466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 384/785] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:10 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:12.126264 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d8c28fd4-b8f9-4ad3-baec-def0f364d0cf tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "POST /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.021884 Aug 29 23:57:12.127098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 402/786] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:57:11 2022] POST /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments => generated 194 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:12.157491 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-084cea57-a99c-4d9b-a7cc-d31d1787618e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:12.158170 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-084cea57-a99c-4d9b-a7cc-d31d1787618e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:12.165232 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-084cea57-a99c-4d9b-a7cc-d31d1787618e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:12.165858 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-084cea57-a99c-4d9b-a7cc-d31d1787618e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:12.166384 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-084cea57-a99c-4d9b-a7cc-d31d1787618e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:12.167202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-084cea57-a99c-4d9b-a7cc-d31d1787618e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:12.167840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-084cea57-a99c-4d9b-a7cc-d31d1787618e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:12.168350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-084cea57-a99c-4d9b-a7cc-d31d1787618e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:12.331558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-084cea57-a99c-4d9b-a7cc-d31d1787618e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:12.345678 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-084cea57-a99c-4d9b-a7cc-d31d1787618e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1368 microversion: 2.1 time: 0.191970 Aug 29 23:57:12.347015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 385/787] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:12 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:13.375822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-45326714-d232-4a5e-8cf6-bd792f87ddec tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:13.377127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-45326714-d232-4a5e-8cf6-bd792f87ddec tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:13.389094 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45326714-d232-4a5e-8cf6-bd792f87ddec tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:13.389601 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45326714-d232-4a5e-8cf6-bd792f87ddec tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:13.390034 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45326714-d232-4a5e-8cf6-bd792f87ddec tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:13.390794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45326714-d232-4a5e-8cf6-bd792f87ddec tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:13.391260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45326714-d232-4a5e-8cf6-bd792f87ddec tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:13.391678 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-45326714-d232-4a5e-8cf6-bd792f87ddec tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:13.575342 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-45326714-d232-4a5e-8cf6-bd792f87ddec tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:13.587232 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-45326714-d232-4a5e-8cf6-bd792f87ddec tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1368 microversion: 2.1 time: 0.221647 Aug 29 23:57:13.588152 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 403/788] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:13 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:14.610950 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3b857acd-6d48-40cf-bea0-33f4e7d44bea tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:14.613096 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3b857acd-6d48-40cf-bea0-33f4e7d44bea tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:14.623659 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3b857acd-6d48-40cf-bea0-33f4e7d44bea tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:14.624238 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3b857acd-6d48-40cf-bea0-33f4e7d44bea tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:14.624746 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3b857acd-6d48-40cf-bea0-33f4e7d44bea tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:14.627643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3b857acd-6d48-40cf-bea0-33f4e7d44bea tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:14.627643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3b857acd-6d48-40cf-bea0-33f4e7d44bea tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:14.627643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3b857acd-6d48-40cf-bea0-33f4e7d44bea tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:14.830869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3b857acd-6d48-40cf-bea0-33f4e7d44bea tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:14.845271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3b857acd-6d48-40cf-bea0-33f4e7d44bea tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1368 microversion: 2.1 time: 0.239289 Aug 29 23:57:14.846455 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 386/789] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:14 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:15.048830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:15.049964 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=6 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:15.315451 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-23509193-5198-4159-a57a-a59e7c4454bc req-669a6093-2a26-4021-9113-4e55938466cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a4eed7-3b9b-45e9-9a5f-e022b5e59825", "name": "network-vif-plugged", "status": "completed", "tag": "d3c7c9a6-8c48-452c-bdc9-84311c5e0ebb"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:15.315451 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-23509193-5198-4159-a57a-a59e7c4454bc req-669a6093-2a26-4021-9113-4e55938466cd service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:15.315451 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-23509193-5198-4159-a57a-a59e7c4454bc req-669a6093-2a26-4021-9113-4e55938466cd service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:15.315451 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-23509193-5198-4159-a57a-a59e7c4454bc req-669a6093-2a26-4021-9113-4e55938466cd service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:15.321918 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-23509193-5198-4159-a57a-a59e7c4454bc req-669a6093-2a26-4021-9113-4e55938466cd service nova] Creating event network-vif-plugged:d3c7c9a6-8c48-452c-bdc9-84311c5e0ebb for instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 on hv-cinder-85427 Aug 29 23:57:15.329274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-23509193-5198-4159-a57a-a59e7c4454bc req-669a6093-2a26-4021-9113-4e55938466cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286799 Aug 29 23:57:15.330252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 404/790] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:15.869645 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-af90fd50-7c41-4a28-bf09-87207d3d813e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:15.871152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-af90fd50-7c41-4a28-bf09-87207d3d813e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:15.873737 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=6 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:15.883800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-af90fd50-7c41-4a28-bf09-87207d3d813e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:15.884616 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-af90fd50-7c41-4a28-bf09-87207d3d813e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:15.885629 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-af90fd50-7c41-4a28-bf09-87207d3d813e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:15.886908 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-af90fd50-7c41-4a28-bf09-87207d3d813e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:15.887654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-af90fd50-7c41-4a28-bf09-87207d3d813e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:15.888396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-af90fd50-7c41-4a28-bf09-87207d3d813e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:16.246724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-af90fd50-7c41-4a28-bf09-87207d3d813e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:16.255533 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-af90fd50-7c41-4a28-bf09-87207d3d813e tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1368 microversion: 2.1 time: 0.391915 Aug 29 23:57:16.256162 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 387/791] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:15 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1368 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:17.279076 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fec9c09a-74b7-41cb-82f4-570cf54685f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:17.279794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fec9c09a-74b7-41cb-82f4-570cf54685f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:17.286883 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fec9c09a-74b7-41cb-82f4-570cf54685f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:17.292258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fec9c09a-74b7-41cb-82f4-570cf54685f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:17.292258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fec9c09a-74b7-41cb-82f4-570cf54685f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:17.292258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fec9c09a-74b7-41cb-82f4-570cf54685f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:17.292258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fec9c09a-74b7-41cb-82f4-570cf54685f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:17.292702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fec9c09a-74b7-41cb-82f4-570cf54685f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:17.468048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fec9c09a-74b7-41cb-82f4-570cf54685f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:17.477755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fec9c09a-74b7-41cb-82f4-570cf54685f9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1368 microversion: 2.1 time: 0.203727 Aug 29 23:57:17.478346 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 405/792] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:17 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:18.516064 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6736fcae-0acf-453a-a616-4e0367cec2a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:18.516860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6736fcae-0acf-453a-a616-4e0367cec2a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:18.523209 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6736fcae-0acf-453a-a616-4e0367cec2a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:18.524381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6736fcae-0acf-453a-a616-4e0367cec2a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:18.524381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6736fcae-0acf-453a-a616-4e0367cec2a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:18.525478 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6736fcae-0acf-453a-a616-4e0367cec2a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:18.526038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6736fcae-0acf-453a-a616-4e0367cec2a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:18.526554 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6736fcae-0acf-453a-a616-4e0367cec2a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:18.680566 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6736fcae-0acf-453a-a616-4e0367cec2a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:18.693429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6736fcae-0acf-453a-a616-4e0367cec2a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1557 microversion: 2.1 time: 0.181267 Aug 29 23:57:18.694090 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 388/793] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:18 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1557 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:18.718827 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3db377f9-4c84-4e94-ad32-53a296daa477 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:18.718827 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3db377f9-4c84-4e94-ad32-53a296daa477 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:18.724566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db377f9-4c84-4e94-ad32-53a296daa477 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:18.725052 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db377f9-4c84-4e94-ad32-53a296daa477 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:18.725486 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db377f9-4c84-4e94-ad32-53a296daa477 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:18.726213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db377f9-4c84-4e94-ad32-53a296daa477 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:18.726711 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db377f9-4c84-4e94-ad32-53a296daa477 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:18.727150 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3db377f9-4c84-4e94-ad32-53a296daa477 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:18.819969 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3db377f9-4c84-4e94-ad32-53a296daa477 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108054 Aug 29 23:57:18.824337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 406/794] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Aug 29 23:57:18 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:19.946068 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-ee3fa1c8-022e-448f-a635-2071f5777a8e req-f21a0d4a-9d57-47bf-a2e2-e85c89d2f799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3a4eed7-3b9b-45e9-9a5f-e022b5e59825", "tag": "d3c7c9a6-8c48-452c-bdc9-84311c5e0ebb"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:19.956960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ee3fa1c8-022e-448f-a635-2071f5777a8e req-f21a0d4a-9d57-47bf-a2e2-e85c89d2f799 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:19.957438 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ee3fa1c8-022e-448f-a635-2071f5777a8e req-f21a0d4a-9d57-47bf-a2e2-e85c89d2f799 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:19.957873 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-ee3fa1c8-022e-448f-a635-2071f5777a8e req-f21a0d4a-9d57-47bf-a2e2-e85c89d2f799 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:19.972567 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-ee3fa1c8-022e-448f-a635-2071f5777a8e req-f21a0d4a-9d57-47bf-a2e2-e85c89d2f799 service nova] Creating event network-changed:d3c7c9a6-8c48-452c-bdc9-84311c5e0ebb for instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 on hv-cinder-85427 Aug 29 23:57:19.979074 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-ee3fa1c8-022e-448f-a635-2071f5777a8e req-f21a0d4a-9d57-47bf-a2e2-e85c89d2f799 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037139 Aug 29 23:57:19.979677 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 389/795] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:57:20.930028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-813020ae-06cb-4f36-aa17-8dc63349d0f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:20.933051 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-813020ae-06cb-4f36-aa17-8dc63349d0f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:20.939741 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-813020ae-06cb-4f36-aa17-8dc63349d0f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:20.940234 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-813020ae-06cb-4f36-aa17-8dc63349d0f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:20.940670 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-813020ae-06cb-4f36-aa17-8dc63349d0f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:20.941373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-813020ae-06cb-4f36-aa17-8dc63349d0f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:20.941979 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-813020ae-06cb-4f36-aa17-8dc63349d0f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:20.942321 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-813020ae-06cb-4f36-aa17-8dc63349d0f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:20.979232 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-813020ae-06cb-4f36-aa17-8dc63349d0f2 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053682 Aug 29 23:57:20.979835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 407/796] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:20 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:21.122440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7c3b675e-d722-4c3c-900a-4171426e3762 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:21.124090 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7c3b675e-d722-4c3c-900a-4171426e3762 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:21.131425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c3b675e-d722-4c3c-900a-4171426e3762 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:21.131926 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c3b675e-d722-4c3c-900a-4171426e3762 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:21.132417 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c3b675e-d722-4c3c-900a-4171426e3762 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:21.133315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c3b675e-d722-4c3c-900a-4171426e3762 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:21.133665 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c3b675e-d722-4c3c-900a-4171426e3762 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:21.134088 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c3b675e-d722-4c3c-900a-4171426e3762 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:21.169846 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7c3b675e-d722-4c3c-900a-4171426e3762 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments/35a4e4b7-b039-4741-878d-4b81f94a99d6" status: 200 len: 194 microversion: 2.1 time: 0.052809 Aug 29 23:57:21.170673 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 390/797] 10.222.0.58 () {58 vars in 1413 bytes} [Mon Aug 29 23:57:21 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments/35a4e4b7-b039-4741-878d-4b81f94a99d6 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:21.182001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8abecf06-d528-4a8f-970e-f92c58fd3a26 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:21.182567 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8abecf06-d528-4a8f-970e-f92c58fd3a26 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:21.189206 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8abecf06-d528-4a8f-970e-f92c58fd3a26 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:21.189719 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8abecf06-d528-4a8f-970e-f92c58fd3a26 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:21.190170 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8abecf06-d528-4a8f-970e-f92c58fd3a26 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:21.190914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8abecf06-d528-4a8f-970e-f92c58fd3a26 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:21.191365 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8abecf06-d528-4a8f-970e-f92c58fd3a26 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:21.191827 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8abecf06-d528-4a8f-970e-f92c58fd3a26 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:21.283292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-8abecf06-d528-4a8f-970e-f92c58fd3a26 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lazy-loading 'services' on Instance uuid 9fcf4e47-8d33-4c78-a889-876e9f941757 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:57:21.521893 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8abecf06-d528-4a8f-970e-f92c58fd3a26 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments/35a4e4b7-b039-4741-878d-4b81f94a99d6" status: 202 len: 0 microversion: 2.1 time: 0.344106 Aug 29 23:57:21.522516 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 408/798] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Aug 29 23:57:21 2022] DELETE /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments/35a4e4b7-b039-4741-878d-4b81f94a99d6 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:57:23.265248 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-829891e2-1d8b-4f59-a279-3b190512e8b0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:23.265997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-829891e2-1d8b-4f59-a279-3b190512e8b0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:23.272516 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-829891e2-1d8b-4f59-a279-3b190512e8b0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.273006 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-829891e2-1d8b-4f59-a279-3b190512e8b0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.273435 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-829891e2-1d8b-4f59-a279-3b190512e8b0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:23.274362 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-829891e2-1d8b-4f59-a279-3b190512e8b0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.274840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-829891e2-1d8b-4f59-a279-3b190512e8b0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.287055 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-829891e2-1d8b-4f59-a279-3b190512e8b0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:23.302674 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-829891e2-1d8b-4f59-a279-3b190512e8b0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/ips" status: 200 len: 151 microversion: 2.20 time: 0.042343 Aug 29 23:57:23.303192 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 391/799] 10.222.0.58 () {60 vars in 1289 bytes} [Mon Aug 29 23:57:23 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 23:57:23.724152 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a9f5f48f-a357-4846-800d-f8a44a689c90 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:23.724819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a9f5f48f-a357-4846-800d-f8a44a689c90 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:23.732661 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9f5f48f-a357-4846-800d-f8a44a689c90 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.733153 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9f5f48f-a357-4846-800d-f8a44a689c90 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.733623 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9f5f48f-a357-4846-800d-f8a44a689c90 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:23.734337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9f5f48f-a357-4846-800d-f8a44a689c90 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.734824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9f5f48f-a357-4846-800d-f8a44a689c90 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.735247 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9f5f48f-a357-4846-800d-f8a44a689c90 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:23.780278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a9f5f48f-a357-4846-800d-f8a44a689c90 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments/cab5702d-3cc3-4449-b7a5-4a1c4964f5f8" status: 200 len: 194 microversion: 2.1 time: 0.061307 Aug 29 23:57:23.780906 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 409/800] 10.222.0.58 () {58 vars in 1413 bytes} [Mon Aug 29 23:57:23 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments/cab5702d-3cc3-4449-b7a5-4a1c4964f5f8 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:23.792288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-67928693-0a16-422d-b455-7b616e07aca1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:23.792778 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-67928693-0a16-422d-b455-7b616e07aca1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:23.799229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-67928693-0a16-422d-b455-7b616e07aca1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.799730 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-67928693-0a16-422d-b455-7b616e07aca1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.800162 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-67928693-0a16-422d-b455-7b616e07aca1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:23.800870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-67928693-0a16-422d-b455-7b616e07aca1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:23.801354 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-67928693-0a16-422d-b455-7b616e07aca1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:23.801779 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-67928693-0a16-422d-b455-7b616e07aca1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:23.916862 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-67928693-0a16-422d-b455-7b616e07aca1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lazy-loading 'services' on Instance uuid 9fcf4e47-8d33-4c78-a889-876e9f941757 {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:57:24.157116 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-67928693-0a16-422d-b455-7b616e07aca1 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments/cab5702d-3cc3-4449-b7a5-4a1c4964f5f8" status: 202 len: 0 microversion: 2.1 time: 0.369040 Aug 29 23:57:24.157914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 392/801] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Aug 29 23:57:23 2022] DELETE /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments/cab5702d-3cc3-4449-b7a5-4a1c4964f5f8 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:57:25.352675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-99c94193-9f96-49d7-a8dd-22bfc7c3b51e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:25.356911 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-99c94193-9f96-49d7-a8dd-22bfc7c3b51e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:25.369783 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99c94193-9f96-49d7-a8dd-22bfc7c3b51e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.370653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99c94193-9f96-49d7-a8dd-22bfc7c3b51e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.371097 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99c94193-9f96-49d7-a8dd-22bfc7c3b51e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.371825 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99c94193-9f96-49d7-a8dd-22bfc7c3b51e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.372283 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99c94193-9f96-49d7-a8dd-22bfc7c3b51e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.372694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99c94193-9f96-49d7-a8dd-22bfc7c3b51e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.405633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-99c94193-9f96-49d7-a8dd-22bfc7c3b51e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057358 Aug 29 23:57:25.406204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 410/802] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:25 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:57:25.558644 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-27c73d33-53ab-418d-9b0b-b74ba3bdc694 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:25.561041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-27c73d33-53ab-418d-9b0b-b74ba3bdc694 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:25.568432 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27c73d33-53ab-418d-9b0b-b74ba3bdc694 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.569204 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27c73d33-53ab-418d-9b0b-b74ba3bdc694 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.569349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27c73d33-53ab-418d-9b0b-b74ba3bdc694 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.570003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27c73d33-53ab-418d-9b0b-b74ba3bdc694 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.570471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27c73d33-53ab-418d-9b0b-b74ba3bdc694 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.570892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27c73d33-53ab-418d-9b0b-b74ba3bdc694 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.607784 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-27c73d33-53ab-418d-9b0b-b74ba3bdc694 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054487 Aug 29 23:57:25.608345 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 393/803] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:57:25 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:57:25.676098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6058c0ab-f825-4aec-9858-648c07908a9e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:25.676639 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6058c0ab-f825-4aec-9858-648c07908a9e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:25.683598 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6058c0ab-f825-4aec-9858-648c07908a9e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.684087 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6058c0ab-f825-4aec-9858-648c07908a9e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.684524 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6058c0ab-f825-4aec-9858-648c07908a9e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.685274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6058c0ab-f825-4aec-9858-648c07908a9e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.685729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6058c0ab-f825-4aec-9858-648c07908a9e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.686215 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6058c0ab-f825-4aec-9858-648c07908a9e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.712115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6058c0ab-f825-4aec-9858-648c07908a9e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:57:25.870659 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:25.950461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6e294305-fd92-4276-a319-e13e8894e095 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:25.950913 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6e294305-fd92-4276-a319-e13e8894e095 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:25.957000 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6e294305-fd92-4276-a319-e13e8894e095 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.957986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6e294305-fd92-4276-a319-e13e8894e095 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.957986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6e294305-fd92-4276-a319-e13e8894e095 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.958619 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6e294305-fd92-4276-a319-e13e8894e095 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:25.959071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6e294305-fd92-4276-a319-e13e8894e095 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:25.959493 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6e294305-fd92-4276-a319-e13e8894e095 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:25.984911 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-6e294305-fd92-4276-a319-e13e8894e095 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lazy-loading 'flavor' on Instance uuid 37a5a820-1da2-47e6-b6e9-6586034c7fcf {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:57:26.133442 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6058c0ab-f825-4aec-9858-648c07908a9e tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 204 len: 0 microversion: 2.1 time: 0.461734 Aug 29 23:57:26.134042 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 411/804] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:57:25 2022] DELETE /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:57:26.143993 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f4db751b-4aea-4d0e-aa8c-55c5f8f68c3d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:26.144724 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f4db751b-4aea-4d0e-aa8c-55c5f8f68c3d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:26.151491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4db751b-4aea-4d0e-aa8c-55c5f8f68c3d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:26.152154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4db751b-4aea-4d0e-aa8c-55c5f8f68c3d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:26.152599 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4db751b-4aea-4d0e-aa8c-55c5f8f68c3d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:26.153520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4db751b-4aea-4d0e-aa8c-55c5f8f68c3d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:26.153978 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4db751b-4aea-4d0e-aa8c-55c5f8f68c3d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:26.154447 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f4db751b-4aea-4d0e-aa8c-55c5f8f68c3d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:26.304283 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f4db751b-4aea-4d0e-aa8c-55c5f8f68c3d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:26.313075 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f4db751b-4aea-4d0e-aa8c-55c5f8f68c3d tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1673 microversion: 2.1 time: 0.173772 Aug 29 23:57:26.313682 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 412/805] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:26 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:57:26.477015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6e294305-fd92-4276-a319-e13e8894e095 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "POST /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/action" status: 202 len: 0 microversion: 2.20 time: 0.530540 Aug 29 23:57:26.477572 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 394/806] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Aug 29 23:57:25 2022] POST /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:57:26.487193 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:26.488063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:26.496415 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:26.496899 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:26.497392 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:26.498130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:26.498605 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:26.499018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:26.664185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:26.673992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:26.675478 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:26.676640 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-22022dd0-ddba-4f85-b8d6-a9d0d9aff285 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.193854 Aug 29 23:57:26.677271 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 413/807] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:26 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:27.336607 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3fdbdc91-878d-4ee9-9ff5-b701bc654046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:27.337297 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3fdbdc91-878d-4ee9-9ff5-b701bc654046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:27.345440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3fdbdc91-878d-4ee9-9ff5-b701bc654046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:27.345917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3fdbdc91-878d-4ee9-9ff5-b701bc654046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:27.346343 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3fdbdc91-878d-4ee9-9ff5-b701bc654046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:27.347066 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3fdbdc91-878d-4ee9-9ff5-b701bc654046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:27.347514 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3fdbdc91-878d-4ee9-9ff5-b701bc654046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:27.347929 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3fdbdc91-878d-4ee9-9ff5-b701bc654046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:27.508751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3fdbdc91-878d-4ee9-9ff5-b701bc654046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:27.513365 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:27.518058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3fdbdc91-878d-4ee9-9ff5-b701bc654046 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1673 microversion: 2.1 time: 0.186101 Aug 29 23:57:27.518672 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 395/808] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:27 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:27.700954 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:27.701552 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:27.709633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:27.710117 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:27.713490 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:27.713490 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:27.713490 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:27.713490 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:28.213528 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:28.225192 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:28.227557 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:28.232507 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-514481b6-1871-4381-ad4d-e7a39803dd43 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.534449 Aug 29 23:57:28.234103 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 414/809] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:27 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:57:28.542220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3044de80-94db-4f88-b466-b14b12b8baf9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:28.543296 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3044de80-94db-4f88-b466-b14b12b8baf9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:28.553967 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3044de80-94db-4f88-b466-b14b12b8baf9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:28.554631 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3044de80-94db-4f88-b466-b14b12b8baf9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:28.570600 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3044de80-94db-4f88-b466-b14b12b8baf9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:28.571692 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3044de80-94db-4f88-b466-b14b12b8baf9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:28.573087 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3044de80-94db-4f88-b466-b14b12b8baf9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:28.573888 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3044de80-94db-4f88-b466-b14b12b8baf9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:28.772791 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3044de80-94db-4f88-b466-b14b12b8baf9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:28.781898 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3044de80-94db-4f88-b466-b14b12b8baf9 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1673 microversion: 2.1 time: 0.244881 Aug 29 23:57:28.782674 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 396/810] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:28 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1673 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:29.177662 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-925e1e2d-b0a3-4601-8f96-cc1a3d05073a req-dc1fa061-2f81-45fd-a199-b0b64042833f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcf4e47-8d33-4c78-a889-876e9f941757", "name": "network-vif-deleted", "tag": "9aab1db7-2f82-4fbf-b6c0-7f1a581d7326"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:29.189413 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-925e1e2d-b0a3-4601-8f96-cc1a3d05073a req-dc1fa061-2f81-45fd-a199-b0b64042833f service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:29.190589 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-925e1e2d-b0a3-4601-8f96-cc1a3d05073a req-dc1fa061-2f81-45fd-a199-b0b64042833f service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:29.190589 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-925e1e2d-b0a3-4601-8f96-cc1a3d05073a req-dc1fa061-2f81-45fd-a199-b0b64042833f service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:29.207838 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-925e1e2d-b0a3-4601-8f96-cc1a3d05073a req-dc1fa061-2f81-45fd-a199-b0b64042833f service nova] Creating event network-vif-deleted:9aab1db7-2f82-4fbf-b6c0-7f1a581d7326 for instance 9fcf4e47-8d33-4c78-a889-876e9f941757 on hv-cinder-85427 Aug 29 23:57:29.213649 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-925e1e2d-b0a3-4601-8f96-cc1a3d05073a req-dc1fa061-2f81-45fd-a199-b0b64042833f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039783 Aug 29 23:57:29.214170 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 415/811] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:29.259559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:29.260819 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:29.268746 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:29.269584 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:29.272107 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:29.272107 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:29.272107 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:29.272107 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:29.451283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:29.459774 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:29.461902 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:29.464181 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-78df9b32-5931-4919-8b66-1f8886651677 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.207520 Aug 29 23:57:29.464963 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 397/812] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:29 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:29.804551 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:29.805684 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:29.812324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:29.812721 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:29.816788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:29.816788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:29.816788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:29.816788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:29.849928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:29.850401 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:29.851278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:29.851454 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lazy-loading 'fault' on Instance uuid 9fcf4e47-8d33-4c78-a889-876e9f941757 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:57:29.899335 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db604b7af623452fac9b3712b6978168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d358f3073d446f49dc51777a7afc30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:29.922624 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-dc97ef83-7f22-479c-b542-d46f3edb727f tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 200 len: 1327 microversion: 2.1 time: 0.121882 Aug 29 23:57:29.923845 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 416/813] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:29 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 1327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:30.489085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:30.489703 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:30.497266 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:30.497755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:30.498189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:30.498932 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:30.499374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:30.499806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:30.644224 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:30.653489 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:30.658287 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:30.658287 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6b25b511-5118-4d8c-b1a7-3056cd83acb8 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.171195 Aug 29 23:57:30.658287 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 398/814] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:30 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:57:30.945250 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:30.945800 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:30.952522 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:30.952998 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:30.953432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:30.954120 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:30.954592 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:30.955006 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:30.968746 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] HTTP exception thrown: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Request method failure captured: Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 HTTP/1.1 Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVDv_g7TBwcydF81qdvi-pt5eLIM0ZAsa22eVJvwXJ243_TxskKKUmG7Eg6hTMAKBT7ma_9G8GsBje35KliHD55VokENYpXLkPRu3qHm3c9suS2Isi3CcYkZaGdQoqopf5zSmmDWp6nPsYQnmJX6SfwdkfrF3wDrvmYfFwAB2AqnlhY Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:57:30.970650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2d358f3073d446f49dc51777a7afc30e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: db604b7af623452fac9b3712b6978168 Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:30.972243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '9fcf4e47-8d33-4c78-a889-876e9f941757'} Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:57:30.973186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:30.974742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:30.976090 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Returning 404 to user: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:57:30.976090 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2c7d7a8f-7eef-4848-83b8-1114f0010209 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 404 len: 111 microversion: 2.1 time: 0.030931 Aug 29 23:57:30.976090 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 417/815] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:30 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:30.981948 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4b69c9f2-c48b-44ad-9fbf-6fd7e89eac31 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '.version_select at 0x7fabbdd040d0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:31.077500 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4b69c9f2-c48b-44ad-9fbf-6fd7e89eac31 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009252561" status: 202 len: 0 microversion: 2.1 time: 0.100034 Aug 29 23:57:31.078085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 399/816] 10.222.0.58 () {58 vars in 1221 bytes} [Mon Aug 29 23:57:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009252561 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:57:31.684291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:31.684999 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:31.691140 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:31.691616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:31.692101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:31.692820 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:31.693262 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:31.693668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:31.845018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:31.853364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:31.855205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:31.856377 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0aa7c4db-1c56-4ff3-adc4-833162512adb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.177440 Aug 29 23:57:31.856916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 418/817] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:31 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:32.880229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:32.880826 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:32.888103 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:32.890548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:32.890548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:32.890548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:32.890548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:32.891040 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:33.049302 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:33.058009 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:33.059497 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:33.060679 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d5edf484-5e9f-4690-9b31-5dc14400c978 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.185019 Aug 29 23:57:33.061239 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 400/818] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:32 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:57:34.089550 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:34.090672 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:34.102623 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:34.104860 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:34.105581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:34.106878 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:34.107820 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:34.108605 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:34.268609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:34.278746 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:34.280259 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:34.281443 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-15cce6e8-2f12-4eef-ae22-e4d52496615e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.198185 Aug 29 23:57:34.281994 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 419/819] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:34 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:34.570819 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:34.571299 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:34.580800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:34.580800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:34.580800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:34.580800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:34.581273 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:34.581273 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:34.597416 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] HTTP exception thrown: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Request method failure captured: Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: DELETE /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 HTTP/1.1 Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVDv_g7TBwcydF81qdvi-pt5eLIM0ZAsa22eVJvwXJ243_TxskKKUmG7Eg6hTMAKBT7ma_9G8GsBje35KliHD55VokENYpXLkPRu3qHm3c9suS2Isi3CcYkZaGdQoqopf5zSmmDWp6nPsYQnmJX6SfwdkfrF3wDrvmYfFwAB2AqnlhY Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:57:34.599183 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2d358f3073d446f49dc51777a7afc30e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: db604b7af623452fac9b3712b6978168 Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:34.600749 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '9fcf4e47-8d33-4c78-a889-876e9f941757'} Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:57:34.601475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:34.602697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:57:34.604193 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Returning 404 to user: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:57:34.604193 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6c31366f-2d37-4b4d-9db9-413cd3040dfc tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 404 len: 111 microversion: 2.1 time: 0.033759 Aug 29 23:57:34.604193 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 401/820] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:57:34 2022] DELETE /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:34.608997 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:34.609609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 9fcf4e47-8d33-4c78-a889-876e9f941757] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:34.611572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:34.616314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:34.616794 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:34.617224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:34.617910 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:34.618357 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:34.618816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:34.632857 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] HTTP exception thrown: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Request method failure captured: Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 HTTP/1.1 Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVDv_g7TBwcydF81qdvi-pt5eLIM0ZAsa22eVJvwXJ243_TxskKKUmG7Eg6hTMAKBT7ma_9G8GsBje35KliHD55VokENYpXLkPRu3qHm3c9suS2Isi3CcYkZaGdQoqopf5zSmmDWp6nPsYQnmJX6SfwdkfrF3wDrvmYfFwAB2AqnlhY Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:57:34.634367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2d358f3073d446f49dc51777a7afc30e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: db604b7af623452fac9b3712b6978168 Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:34.640109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '9fcf4e47-8d33-4c78-a889-876e9f941757'} Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:57:34.640973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. Aug 29 23:57:34.642386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:34.643799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Returning 404 to user: Instance 9fcf4e47-8d33-4c78-a889-876e9f941757 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:57:34.643799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2978ad40-4064-43c4-800e-39882ba51205 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757" status: 404 len: 111 microversion: 2.1 time: 0.031072 Aug 29 23:57:34.643799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 420/821] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:34 2022] GET /compute/v2.1/servers/9fcf4e47-8d33-4c78-a889-876e9f941757 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:35.305460 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:35.306090 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:35.312187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:35.312675 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:35.313113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:35.313815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:35.314265 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:35.314741 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:35.474886 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:35.484315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:35.485896 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:35.487516 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8872c4e1-60ea-4e69-80aa-faf2ddf7a8f3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.185806 Aug 29 23:57:35.488070 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 402/822] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:35 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:35.941824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:35.943014 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:35.951483 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:35.952060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:35.952562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:35.953426 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:35.953944 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:35.954464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:35.973442 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] HTTP exception thrown: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Request method failure captured: Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: DELETE /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a HTTP/1.1 Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVDv_g7TBwcydF81qdvi-pt5eLIM0ZAsa22eVJvwXJ243_TxskKKUmG7Eg6hTMAKBT7ma_9G8GsBje35KliHD55VokENYpXLkPRu3qHm3c9suS2Isi3CcYkZaGdQoqopf5zSmmDWp6nPsYQnmJX6SfwdkfrF3wDrvmYfFwAB2AqnlhY Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:57:35.975045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2d358f3073d446f49dc51777a7afc30e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: db604b7af623452fac9b3712b6978168 Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:57:35.981696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a'} Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:57:35.982600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:57:35.984037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:57:35.985437 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Returning 404 to user: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:57:35.985437 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6ea12787-43ae-48d1-83c1-05fb8a4b9be3 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 404 len: 111 microversion: 2.1 time: 0.039723 Aug 29 23:57:35.985437 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 421/823] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:57:35 2022] DELETE /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:35.991833 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:35.992713 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] [instance: 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:36.001868 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:36.002564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:36.002984 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.003786 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:36.004241 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:36.004668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.022862 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] HTTP exception thrown: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Request method failure captured: Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a HTTP/1.1 Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVDv_g7TBwcydF81qdvi-pt5eLIM0ZAsa22eVJvwXJ243_TxskKKUmG7Eg6hTMAKBT7ma_9G8GsBje35KliHD55VokENYpXLkPRu3qHm3c9suS2Isi3CcYkZaGdQoqopf5zSmmDWp6nPsYQnmJX6SfwdkfrF3wDrvmYfFwAB2AqnlhY Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:57:36.024419 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2d358f3073d446f49dc51777a7afc30e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2d358f3073d446f49dc51777a7afc30e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 2d358f3073d446f49dc51777a7afc30e Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325623934 Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: db604b7af623452fac9b3712b6978168 Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-AttachVolumeTestJSON-1325623934-project Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:57:36.027008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a'} Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:57:36.028023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. Aug 29 23:57:36.029912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:57:36.045537 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] Returning 404 to user: Instance 4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:57:36.045537 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-25d4429e-960a-45b9-9104-1440473e9329 tempest-AttachVolumeTestJSON-1325623934 tempest-AttachVolumeTestJSON-1325623934-project] 10.222.0.58 "GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a" status: 404 len: 111 microversion: 2.1 time: 0.039124 Aug 29 23:57:36.045537 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 403/824] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:57:35 2022] GET /compute/v2.1/servers/4f8a3dc6-7b8b-4a2e-8adf-cd33cc1ca64a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:57:36.513423 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:36.514220 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:36.521727 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:36.522302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:36.522875 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.523583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:36.524028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:36.524443 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:36.796173 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:36.806790 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:36.809323 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:36.810324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-bde78f11-9107-4dc1-ba08-acb90e561220 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.302965 Aug 29 23:57:36.810996 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 422/825] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:36 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:37.841415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:37.842152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:37.849406 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:37.849789 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:37.850217 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:37.850968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:37.851418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:37.851844 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:38.292289 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:38.300887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:38.302579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:38.303748 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e91af1ea-29a7-4cff-b54e-d8d0b652766b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.466486 Aug 29 23:57:38.304348 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 404/826] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:37 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:39.336877 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:39.336877 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:39.344107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:39.351653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:39.352109 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:39.352872 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:39.353430 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:39.354045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:39.566209 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:39.576111 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:39.577584 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:39.578773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2f2e6f99-d15f-4084-a1c4-a2b9f201ab9b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.252094 Aug 29 23:57:39.579343 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 423/827] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:39 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:40.610006 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:40.613984 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:40.616556 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:40.624941 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:40.626085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:40.626553 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:40.627278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:40.627793 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:40.628211 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:40.770326 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:40.779527 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:40.782335 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:40.782335 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b1b1a3b3-5fcd-48bf-9037-58ef52d4c7ae tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.183093 Aug 29 23:57:40.782729 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 405/828] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:40 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:41.807979 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:41.808817 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:41.815644 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:41.816190 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:41.816692 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:41.817519 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:41.817976 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:41.818412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:41.977264 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:41.986391 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:41.988008 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:41.989215 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-24e1ac86-6a6c-410f-9541-8e75c6d0099e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.186182 Aug 29 23:57:41.989762 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 424/829] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:41 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:43.013628 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:43.014286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:43.021372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:43.021858 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:43.022288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:43.023179 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:43.023630 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:43.024084 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:43.182268 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:43.190750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:43.192280 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:43.193494 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2f3b2a97-f064-4f55-8535-1787f42fb15b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.184241 Aug 29 23:57:43.194045 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 406/830] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:43 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:44.217980 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:44.218554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:44.225646 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:44.226127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:44.226587 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:44.227290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:44.227867 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:44.229120 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:44.422310 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:44.430935 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:44.433508 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:44.434770 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b2eac286-dc9b-4023-b43b-e47d92d6a1ed tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1743 microversion: 2.20 time: 0.220943 Aug 29 23:57:44.435461 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 425/831] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:44 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1743 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:44.703512 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cae187b5-1833-4c68-ab47-4fb0860885f8 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabbdc3ae50>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:44.756745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-cae187b5-1833-4c68-ab47-4fb0860885f8 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/256234d9-472c-41dd-9251-8c3ec6908760" status: 200 len: 349 microversion: 2.1 time: 0.057463 Aug 29 23:57:44.757316 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 407/832] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:57:44 2022] GET /compute/v2.1/os-volumes/256234d9-472c-41dd-9251-8c3ec6908760 => generated 349 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:45.458791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:45.459537 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:45.467804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:45.468296 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:45.468718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:45.479963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:45.479963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:45.479963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:45.763932 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:45.776137 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:45.778355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:45.780254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d75b1411-2e38-4703-9ddc-62df78a6ed52 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1743 microversion: 2.20 time: 0.325627 Aug 29 23:57:45.781786 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 426/833] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:45 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1743 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:57:46.522648 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b2a4c1fc-39ca-4689-8651-7cd7c241c36d tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabbdb7e8b0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:46.581164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b2a4c1fc-39ca-4689-8651-7cd7c241c36d tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/56383da7-57e9-424c-b52a-173a55025b26" status: 200 len: 350 microversion: 2.1 time: 0.062994 Aug 29 23:57:46.586572 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 408/834] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:57:46 2022] GET /compute/v2.1/os-volumes/56383da7-57e9-424c-b52a-173a55025b26 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:46.807209 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:46.809808 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:46.819797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:46.820751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:46.821371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:46.823100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:46.823816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:46.824464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:47.088346 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:47.113836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:47.113836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:47.113836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4a2375e3-1c14-46bf-a86f-9e56d12a666f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.310938 Aug 29 23:57:47.114770 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 427/835] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:46 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:47.195872 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-963aa626-134e-4f2e-b1ac-7df12b62dd4c req-2b935842-e6e3-4c10-83db-e77856f5712e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a5a820-1da2-47e6-b6e9-6586034c7fcf", "name": "network-vif-plugged", "status": "completed", "tag": "92bd74c9-1028-4a8d-a703-f5c8f8637fc5"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:57:47.220469 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-963aa626-134e-4f2e-b1ac-7df12b62dd4c req-2b935842-e6e3-4c10-83db-e77856f5712e service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:47.221168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-963aa626-134e-4f2e-b1ac-7df12b62dd4c req-2b935842-e6e3-4c10-83db-e77856f5712e service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:47.221602 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-963aa626-134e-4f2e-b1ac-7df12b62dd4c req-2b935842-e6e3-4c10-83db-e77856f5712e service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:47.237769 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-963aa626-134e-4f2e-b1ac-7df12b62dd4c req-2b935842-e6e3-4c10-83db-e77856f5712e service nova] Creating event network-vif-plugged:92bd74c9-1028-4a8d-a703-f5c8f8637fc5 for instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf on hv-cinder-85427 Aug 29 23:57:47.242705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-963aa626-134e-4f2e-b1ac-7df12b62dd4c req-2b935842-e6e3-4c10-83db-e77856f5712e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060694 Aug 29 23:57:47.244266 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 409/836] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:48.140340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:48.141180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:48.148749 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:48.149249 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:48.150763 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:48.151054 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:48.169339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:48.172016 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:48.475287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:48.489099 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:48.491763 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:48.494694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-580d9092-2919-44a5-acec-8c56f07d9a37 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.357605 Aug 29 23:57:48.495759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 428/837] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:48 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:48.910272 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1c019dcc-b770-49d5-b150-41545abf57f0 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabbdd733a0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:49.013615 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1c019dcc-b770-49d5-b150-41545abf57f0 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/77b784c2-5452-4873-b0ea-c924384ba8c7" status: 200 len: 350 microversion: 2.1 time: 0.109564 Aug 29 23:57:49.014277 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 410/838] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:57:48 2022] GET /compute/v2.1/os-volumes/77b784c2-5452-4873-b0ea-c924384ba8c7 => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:49.028651 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b3751fc3-3a5d-43d2-a778-7734d3123b56 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabbdc81e50>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:49.129710 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b3751fc3-3a5d-43d2-a778-7734d3123b56 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.106240 Aug 29 23:57:49.130337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 429/839] 10.222.0.58 () {58 vars in 1134 bytes} [Mon Aug 29 23:57:49 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:49.144390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2874f0e8-d90f-4661-b706-ec6a0f87d786 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabbdc9ea60>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:49.280472 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2874f0e8-d90f-4661-b706-ec6a0f87d786 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.139489 Aug 29 23:57:49.280893 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 411/840] 10.222.0.58 () {58 vars in 1149 bytes} [Mon Aug 29 23:57:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:49.295776 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-73838d62-8883-487f-9fb3-44093c1b84ba tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabc17243a0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:49.470183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-73838d62-8883-487f-9fb3-44093c1b84ba tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.179028 Aug 29 23:57:49.471372 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 430/841] 10.222.0.58 () {58 vars in 1134 bytes} [Mon Aug 29 23:57:49 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:49.484012 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2eef638f-7d33-4085-99f6-a7f710b67452 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabbdc11940>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:49.522347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:49.522996 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:49.538181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:49.538732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:49.539161 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:49.541037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:49.541842 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:49.542277 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:49.633425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2eef638f-7d33-4085-99f6-a7f710b67452 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.153180 Aug 29 23:57:49.637131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 412/842] 10.222.0.58 () {58 vars in 1167 bytes} [Mon Aug 29 23:57:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:49.648941 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-94190cde-a7b0-4322-88d9-e1799c62b61e tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabbdcc30d0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:49.796444 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-94190cde-a7b0-4322-88d9-e1799c62b61e tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.150464 Aug 29 23:57:49.796444 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 413/843] 10.222.0.58 () {58 vars in 1170 bytes} [Mon Aug 29 23:57:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:49.810942 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ae21c792-5cfc-473d-92c7-3de631d21f0e tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabbdd1c700>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:49.843097 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:49.861039 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:49.861039 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:49.861039 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-62f8dec3-bebc-4971-befc-01d95186b71e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.340808 Aug 29 23:57:49.861323 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 431/844] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:49 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:57:49.995456 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ae21c792-5cfc-473d-92c7-3de631d21f0e tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.189286 Aug 29 23:57:49.996625 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 414/845] 10.222.0.58 () {58 vars in 1155 bytes} [Mon Aug 29 23:57:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:50.015769 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a3373b7d-2318-485c-a446-fbbb84ee5ce1 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabbdc81ee0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:50.305558 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a3373b7d-2318-485c-a446-fbbb84ee5ce1 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.298154 Aug 29 23:57:50.306749 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 432/846] 10.222.0.58 () {58 vars in 1188 bytes} [Mon Aug 29 23:57:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:57:50.328163 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8cce1eef-c6a2-48ee-9c6d-48fe23aaa889 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] Calling method '.version_select at 0x7fabbdb7e8b0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:50.433432 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8cce1eef-c6a2-48ee-9c6d-48fe23aaa889 tempest-VolumesTestJSON-1729703428 tempest-VolumesTestJSON-1729703428-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.114899 Aug 29 23:57:50.434278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 415/847] 10.222.0.58 () {58 vars in 1155 bytes} [Mon Aug 29 23:57:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:57:50.886862 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:50.887506 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:50.912943 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:50.913867 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:50.914583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:50.921413 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:50.922136 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:50.922833 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:51.144717 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:51.151976 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:57:51.157037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:51.159081 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:51.160709 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5d88aa77-0ba8-4642-b1b5-59fff23427ff tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.278470 Aug 29 23:57:51.178625 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 433/848] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:50 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:52.187163 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:52.188018 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:52.196871 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:52.197556 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:52.198057 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:52.198851 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:52.199342 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:52.199766 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:52.433267 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:52.446095 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:52.449661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:52.451610 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a980c4c8-2669-4d7d-af9f-ccbe3b57eb2f tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.269747 Aug 29 23:57:52.453104 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 416/849] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:52 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:53.480445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:53.481111 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:53.488926 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:53.489630 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:53.491546 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:53.492489 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:53.493219 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:53.493874 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:53.691846 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:53.704055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:53.705830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:53.708254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e050bacc-8418-4997-89a2-2ff38c057f27 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.233880 Aug 29 23:57:53.709079 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 434/850] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:53 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:54.737498 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:54.739554 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:54.748139 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:54.749025 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:54.749693 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:54.755463 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:54.756233 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:54.756936 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:55.092615 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:55.106996 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:55.112202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:55.113644 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4cf30e46-02be-4004-a3fe-67f946abbb15 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.380861 Aug 29 23:57:55.120870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 417/851] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:54 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:56.153029 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:56.156579 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:56.166000 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:56.166779 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:56.169806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:56.170700 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:56.171192 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:56.177803 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:56.847934 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:56.856760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:56.858216 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:56.859426 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-859f70c3-2592-491e-9bc7-eb8739e69740 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.710743 Aug 29 23:57:56.859981 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 435/852] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:56 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:57.883197 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:57.885120 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:57.903357 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:57.904205 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:57.904849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:57.906887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:57.907614 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:57.911152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:58.207654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:58.235237 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:58.237036 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:58.238352 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-39312955-1def-4abb-940b-c245e9e3ac8b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.359615 Aug 29 23:57:58.239097 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 418/853] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:57 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:57:59.268148 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:57:59.270875 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:57:59.295335 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:59.299135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:59.300554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:59.300554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:57:59.300993 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:57:59.301505 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:57:59.586668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:59.608048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:59.613444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:57:59.615020 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a2de7d0c-4cff-4efb-ba48-9efbb867fbd6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.351093 Aug 29 23:57:59.618704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 436/854] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:57:59 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:00.649341 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:00.649958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:00.665326 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:00.666101 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:00.667411 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:00.675641 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:00.676507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:00.677219 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:00.682892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=74 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:00.898369 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:00.920188 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:00.925709 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:00.926202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-02b9bd21-2bc1-4166-9e2b-b9d72d149cbb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.282137 Aug 29 23:58:00.927454 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 419/855] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:00 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:01.959826 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:01.960984 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:01.986702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:01.987614 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:01.997560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:01.997560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:01.997560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:01.997560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:02.347589 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:02.347589 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:02.349002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:02.349002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-30240af9-da6c-45e0-b471-87994a9229e2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.319825 Aug 29 23:58:02.349002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 437/856] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:01 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:02.534675 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-25925701-348e-431c-bb44-eaa7f17315da tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Action: 'create', calling method: .version_select at 0x7fabbdc11a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-406797152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBj/NquA8qIm+WgjknH5Mfd9P0I+cixDJzGt2JSJve8P/UtAtCZryTbbz2hngJ7KSlWRYjATSfiyE9TJsfK7kxLaEhXkQ6tGFsg9sNTswNFN83ppfqF8v8YGn3hIWRCRA=="}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:02.554308 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-25925701-348e-431c-bb44-eaa7f17315da tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Getting quotas for project c78ff4cbc0994af8855b1ac67cb281fe. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:58:02.559731 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-25925701-348e-431c-bb44-eaa7f17315da tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Getting quotas for user 1e63436f5691431d802706a8d5a6df7f and project c78ff4cbc0994af8855b1ac67cb281fe. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:58:02.731011 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-25925701-348e-431c-bb44-eaa7f17315da tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.395447 Aug 29 23:58:02.731635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 420/857] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Aug 29 23:58:02 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:03.308767 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:03.311714 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:03.347253 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:03.350296 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:03.352624 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:03.356644 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:03.360101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:03.360926 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:03.618645 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:03.630370 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:03.632404 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:03.634151 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a008a564-7aa6-43b6-b4fd-6eaef039f749 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.332515 Aug 29 23:58:03.636321 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 438/858] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:03 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:04.020207 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-95ece206-ff95-4dea-9d92-f58b1ac5c874 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:04.022301 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-95ece206-ff95-4dea-9d92-f58b1ac5c874 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:04.054043 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95ece206-ff95-4dea-9d92-f58b1ac5c874 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:04.054952 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95ece206-ff95-4dea-9d92-f58b1ac5c874 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:04.055750 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95ece206-ff95-4dea-9d92-f58b1ac5c874 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:04.061234 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95ece206-ff95-4dea-9d92-f58b1ac5c874 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:04.063956 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95ece206-ff95-4dea-9d92-f58b1ac5c874 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:04.064582 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-95ece206-ff95-4dea-9d92-f58b1ac5c874 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:04.095947 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-95ece206-ff95-4dea-9d92-f58b1ac5c874 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/ips" status: 200 len: 149 microversion: 2.1 time: 0.081537 Aug 29 23:58:04.097119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 421/859] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Aug 29 23:58:04 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/ips => generated 149 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:04.660924 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:04.662877 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:04.670078 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:04.670851 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:04.671341 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:04.672259 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:04.672730 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:04.673168 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:04.985445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:05.003594 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:05.006680 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:05.008783 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-94a36fe7-1956-4d51-ac6f-4177b2cc377e tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1738 microversion: 2.20 time: 0.352060 Aug 29 23:58:05.010357 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 439/860] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:04 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1738 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:06.034450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:06.036479 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:06.047298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:06.048040 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:06.048667 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:06.049443 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:06.051147 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:06.051665 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:06.066828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e4957ab3-f6ed-454b-9998-2107078f3fa2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "496cf460-dad0-40c0-9df5-57f3fadbe9bd"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:06.069435 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e4957ab3-f6ed-454b-9998-2107078f3fa2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:06.081234 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4957ab3-f6ed-454b-9998-2107078f3fa2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:06.083987 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4957ab3-f6ed-454b-9998-2107078f3fa2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:06.084573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4957ab3-f6ed-454b-9998-2107078f3fa2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:06.089459 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4957ab3-f6ed-454b-9998-2107078f3fa2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:06.090132 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4957ab3-f6ed-454b-9998-2107078f3fa2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:06.090847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e4957ab3-f6ed-454b-9998-2107078f3fa2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:06.327450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:06.337496 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:06.339711 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:06.340997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-36b8df8a-a4b2-4a7d-8ac0-422758d55c3d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1720 microversion: 2.20 time: 0.311567 Aug 29 23:58:06.341652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 422/861] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:06 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1720 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:07.367830 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:07.368458 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:07.375874 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:07.376365 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:07.376805 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:07.377513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:07.377967 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:07.378399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:07.536783 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:07.546008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:07.547477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:07.548663 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ce640c3b-6064-480e-b751-a3bc0396ca63 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1720 microversion: 2.20 time: 0.185216 Aug 29 23:58:07.549229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 423/862] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:07 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:08.580414 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:08.580414 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:08.580414 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:08.580414 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:08.581349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:08.581349 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:08.581620 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:08.582037 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:08.721607 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:08.730048 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:08.731536 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:08.732696 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7e1f1d6e-69eb-433f-b9f3-dfa6f2e28db4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1720 microversion: 2.20 time: 0.165242 Aug 29 23:58:08.733253 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 424/863] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:08 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:08.974114 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-adac96e5-8748-47e1-99eb-8351bbe8871a req-8cf7156e-7ff5-47ed-9648-56938fc0c431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a5a820-1da2-47e6-b6e9-6586034c7fcf", "name": "network-vif-unplugged", "status": "completed", "tag": "92bd74c9-1028-4a8d-a703-f5c8f8637fc5"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:08.989416 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-adac96e5-8748-47e1-99eb-8351bbe8871a req-8cf7156e-7ff5-47ed-9648-56938fc0c431 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:08.989897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-adac96e5-8748-47e1-99eb-8351bbe8871a req-8cf7156e-7ff5-47ed-9648-56938fc0c431 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:08.990347 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-adac96e5-8748-47e1-99eb-8351bbe8871a req-8cf7156e-7ff5-47ed-9648-56938fc0c431 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:09.002583 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-adac96e5-8748-47e1-99eb-8351bbe8871a req-8cf7156e-7ff5-47ed-9648-56938fc0c431 service nova] Creating event network-vif-unplugged:92bd74c9-1028-4a8d-a703-f5c8f8637fc5 for instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf on hv-cinder-85427 Aug 29 23:58:09.007548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-adac96e5-8748-47e1-99eb-8351bbe8871a req-8cf7156e-7ff5-47ed-9648-56938fc0c431 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037513 Aug 29 23:58:09.008127 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 425/864] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:58:09.759282 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:09.760283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:09.769730 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:09.771604 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:09.771604 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:09.771604 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:09.771852 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:09.772250 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:09.899170 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e4957ab3-f6ed-454b-9998-2107078f3fa2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "POST /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.837147 Aug 29 23:58:09.900936 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 440/865] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Aug 29 23:58:06 2022] POST /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 194 bytes in 3840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:09.929048 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:09.946350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:09.949015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:09.950890 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-47f6de5e-149f-4bb7-88d8-c5b54f698f7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1723 microversion: 2.20 time: 0.196407 Aug 29 23:58:09.951835 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 426/866] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:09 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:09.983242 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9e92142f-9deb-481c-a826-b423d7b450ab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a2cf673-6b6c-4df3-8f4b-e4d45177160e"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:09.986046 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9e92142f-9deb-481c-a826-b423d7b450ab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:09.988952 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=36 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:09.997215 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e92142f-9deb-481c-a826-b423d7b450ab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:09.997716 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e92142f-9deb-481c-a826-b423d7b450ab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:09.998145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e92142f-9deb-481c-a826-b423d7b450ab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:09.998903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e92142f-9deb-481c-a826-b423d7b450ab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:09.999347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e92142f-9deb-481c-a826-b423d7b450ab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:09.999763 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9e92142f-9deb-481c-a826-b423d7b450ab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:11.795769 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9e92142f-9deb-481c-a826-b423d7b450ab tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "POST /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.817512 Aug 29 23:58:11.796434 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 441/867] 10.222.0.58 () {62 vars in 1364 bytes} [Mon Aug 29 23:58:09 2022] POST /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/os-volume_attachments => generated 188 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 23:58:11.929324 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-91c55173-46ac-4594-bb82-5079e6c70221 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:11.929861 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-91c55173-46ac-4594-bb82-5079e6c70221 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:11.936558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91c55173-46ac-4594-bb82-5079e6c70221 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:11.937036 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91c55173-46ac-4594-bb82-5079e6c70221 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:11.937579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91c55173-46ac-4594-bb82-5079e6c70221 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:11.938299 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91c55173-46ac-4594-bb82-5079e6c70221 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:11.938774 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91c55173-46ac-4594-bb82-5079e6c70221 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:11.939194 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-91c55173-46ac-4594-bb82-5079e6c70221 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.515410 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-91c55173-46ac-4594-bb82-5079e6c70221 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "DELETE /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/os-volume_attachments/9a2cf673-6b6c-4df3-8f4b-e4d45177160e" status: 202 len: 0 microversion: 2.20 time: 0.590134 Aug 29 23:58:12.515984 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 427/868] 10.222.0.58 () {60 vars in 1457 bytes} [Mon Aug 29 23:58:11 2022] DELETE /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/os-volume_attachments/9a2cf673-6b6c-4df3-8f4b-e4d45177160e => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:58:12.589822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-89d58639-cfbb-413b-bf72-39b26ebeb5e5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:12.590414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-89d58639-cfbb-413b-bf72-39b26ebeb5e5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:12.598116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89d58639-cfbb-413b-bf72-39b26ebeb5e5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:12.598798 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89d58639-cfbb-413b-bf72-39b26ebeb5e5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:12.599390 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89d58639-cfbb-413b-bf72-39b26ebeb5e5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.600405 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89d58639-cfbb-413b-bf72-39b26ebeb5e5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:12.600922 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89d58639-cfbb-413b-bf72-39b26ebeb5e5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:12.601302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-89d58639-cfbb-413b-bf72-39b26ebeb5e5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:12.653239 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-89d58639-cfbb-413b-bf72-39b26ebeb5e5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127705) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 23:58:13.044292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-89d58639-cfbb-413b-bf72-39b26ebeb5e5 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "POST /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/action" status: 202 len: 0 microversion: 2.20 time: 0.459585 Aug 29 23:58:13.044979 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 442/869] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Aug 29 23:58:12 2022] POST /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 23:58:13.055450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:13.057099 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:13.060086 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=4 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:13.071710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:13.072765 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:13.073273 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:13.074236 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:13.074753 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:13.075190 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:13.264430 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:13.274332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:13.276668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:13.280576 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-cbf8d801-f31f-4d3a-90df-402ff6136464 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1671 microversion: 2.20 time: 0.231167 Aug 29 23:58:13.291932 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 428/870] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:13 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:14.308432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:14.309202 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:14.315737 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:14.316232 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:14.316666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:14.317501 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:14.317958 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:14.318461 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:14.494235 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:14.496777 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:14.498250 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:14.499464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-edac3f92-41ba-41a2-887e-92181de8cb69 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1671 microversion: 2.20 time: 0.195992 Aug 29 23:58:14.500019 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 443/871] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:14 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1671 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:15.530879 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:15.531601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:15.534109 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:15.539114 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:15.539603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:15.540048 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:15.541470 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:15.542333 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:15.543027 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:15.745175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:15.754467 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:15.755933 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:15.757127 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c75d022b-fdc6-4cd1-9e70-9bf6c2e71c97 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.233738 Aug 29 23:58:15.757701 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 429/872] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:15 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:16.783048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:16.783665 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:16.791589 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:16.793121 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:16.794259 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:16.795482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:16.796174 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:16.797012 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:17.127472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:17.136268 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:17.137743 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:17.138958 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-461e2957-4949-4be4-a08d-2b892a522d7a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.360747 Aug 29 23:58:17.139518 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 444/873] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:16 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:18.164316 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:18.167544 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:18.205193 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:18.206974 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:18.208436 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:18.211525 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:18.212220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:18.213683 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:18.439885 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:18.440707 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:18.443008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:18.450518 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-96643c24-b60a-453c-8600-16fa3f20b020 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.285306 Aug 29 23:58:18.451001 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9dec82b8-a11c-415b-ad31-a0ffd92190a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:18.451647 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 430/874] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:18 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:18.452297 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9dec82b8-a11c-415b-ad31-a0ffd92190a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:18.459662 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9dec82b8-a11c-415b-ad31-a0ffd92190a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:18.460155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9dec82b8-a11c-415b-ad31-a0ffd92190a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:18.460582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9dec82b8-a11c-415b-ad31-a0ffd92190a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:18.461287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9dec82b8-a11c-415b-ad31-a0ffd92190a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:18.461732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9dec82b8-a11c-415b-ad31-a0ffd92190a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:18.462150 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9dec82b8-a11c-415b-ad31-a0ffd92190a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:18.518813 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:18.636575 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-9dec82b8-a11c-415b-ad31-a0ffd92190a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lazy-loading 'services' on Instance uuid a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:58:18.893734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9dec82b8-a11c-415b-ad31-a0ffd92190a4 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments/496cf460-dad0-40c0-9df5-57f3fadbe9bd" status: 202 len: 0 microversion: 2.1 time: 0.447451 Aug 29 23:58:18.895131 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 445/875] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Aug 29 23:58:18 2022] DELETE /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments/496cf460-dad0-40c0-9df5-57f3fadbe9bd => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:58:18.904888 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-171390ca-f3d9-4ba7-a1e8-64e98cab4c0d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:18.907810 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-171390ca-f3d9-4ba7-a1e8-64e98cab4c0d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:18.916678 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-171390ca-f3d9-4ba7-a1e8-64e98cab4c0d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:18.928399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-171390ca-f3d9-4ba7-a1e8-64e98cab4c0d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:18.928399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-171390ca-f3d9-4ba7-a1e8-64e98cab4c0d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:18.928399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-171390ca-f3d9-4ba7-a1e8-64e98cab4c0d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:18.928399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-171390ca-f3d9-4ba7-a1e8-64e98cab4c0d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:18.928992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-171390ca-f3d9-4ba7-a1e8-64e98cab4c0d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:18.968004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-171390ca-f3d9-4ba7-a1e8-64e98cab4c0d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068162 Aug 29 23:58:18.975631 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 431/876] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:18 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:19.494167 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:19.498216 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:19.505673 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:19.506164 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:19.506821 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:19.508020 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:19.508431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:19.508857 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:19.725063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:19.742917 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:19.745886 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:19.747971 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-77506026-f5c5-4133-a2d8-dd2dd8b65d11 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.258540 Aug 29 23:58:19.748520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 446/877] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:19 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:19.987781 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9fca65f4-6e5c-4912-8821-16e78590ef4f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:19.987781 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9fca65f4-6e5c-4912-8821-16e78590ef4f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:19.994445 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fca65f4-6e5c-4912-8821-16e78590ef4f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:19.995203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fca65f4-6e5c-4912-8821-16e78590ef4f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:19.995870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fca65f4-6e5c-4912-8821-16e78590ef4f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:19.996752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fca65f4-6e5c-4912-8821-16e78590ef4f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:19.997410 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fca65f4-6e5c-4912-8821-16e78590ef4f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:19.997851 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9fca65f4-6e5c-4912-8821-16e78590ef4f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:20.047925 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9fca65f4-6e5c-4912-8821-16e78590ef4f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068246 Aug 29 23:58:20.048988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 432/878] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:19 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:20.774197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:20.781105 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:20.792016 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:20.792898 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:20.793736 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:20.794739 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:20.795444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:20.796097 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:20.970527 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:20.989442 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:20.993268 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:20.996734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-867a3704-2e18-4feb-a887-aae402851320 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.226052 Aug 29 23:58:20.998838 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 447/879] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:20 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:21.063920 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-890cef7e-8df7-4acf-ada1-ee3ec55caa8f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:21.066866 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-890cef7e-8df7-4acf-ada1-ee3ec55caa8f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:21.075176 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-890cef7e-8df7-4acf-ada1-ee3ec55caa8f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:21.075668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-890cef7e-8df7-4acf-ada1-ee3ec55caa8f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:21.076104 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-890cef7e-8df7-4acf-ada1-ee3ec55caa8f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:21.076817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-890cef7e-8df7-4acf-ada1-ee3ec55caa8f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:21.077267 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-890cef7e-8df7-4acf-ada1-ee3ec55caa8f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:21.077901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-890cef7e-8df7-4acf-ada1-ee3ec55caa8f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:21.112777 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-890cef7e-8df7-4acf-ada1-ee3ec55caa8f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053044 Aug 29 23:58:21.114278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 433/880] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:21 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:22.022660 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:22.024060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:22.031783 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:22.032290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:22.032721 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:22.033435 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:22.042987 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:22.042987 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:22.129901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1b2fa361-e613-4533-adc4-614eb0cf33a8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:22.132211 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1b2fa361-e613-4533-adc4-614eb0cf33a8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:22.147220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b2fa361-e613-4533-adc4-614eb0cf33a8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:22.148016 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b2fa361-e613-4533-adc4-614eb0cf33a8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:22.148632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b2fa361-e613-4533-adc4-614eb0cf33a8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:22.149511 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b2fa361-e613-4533-adc4-614eb0cf33a8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:22.150704 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b2fa361-e613-4533-adc4-614eb0cf33a8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:22.152707 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1b2fa361-e613-4533-adc4-614eb0cf33a8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:22.210815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1b2fa361-e613-4533-adc4-614eb0cf33a8 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084701 Aug 29 23:58:22.214969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 434/881] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:22 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:58:22.252984 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:22.264182 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:22.266306 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:22.268739 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-bfbf07e6-2f2a-452b-88a6-5c5c7fd7a0c1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.250001 Aug 29 23:58:22.269938 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 448/882] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:22 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:23.226401 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4a4286f2-9d26-4ec3-b9d6-9fd8298d9328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:23.232622 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4a4286f2-9d26-4ec3-b9d6-9fd8298d9328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:23.239401 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4a4286f2-9d26-4ec3-b9d6-9fd8298d9328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:23.239883 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4a4286f2-9d26-4ec3-b9d6-9fd8298d9328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:23.240311 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4a4286f2-9d26-4ec3-b9d6-9fd8298d9328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:23.241024 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4a4286f2-9d26-4ec3-b9d6-9fd8298d9328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:23.241465 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4a4286f2-9d26-4ec3-b9d6-9fd8298d9328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:23.241876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4a4286f2-9d26-4ec3-b9d6-9fd8298d9328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:23.247477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:23.278021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4a4286f2-9d26-4ec3-b9d6-9fd8298d9328 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057702 Aug 29 23:58:23.282740 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 435/883] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:23 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:23.294378 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:23.295145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:23.302643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:23.303274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:23.303803 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:23.304611 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:23.305063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:23.305480 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:23.532461 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:23.545607 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:23.547492 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:23.548971 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c331a6d4-ac43-4dde-ae7f-014069432471 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.260027 Aug 29 23:58:23.549915 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 449/884] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:23 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:24.298868 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6b923aaf-b639-45e2-b02a-e3f6e8494ce2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:24.301761 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6b923aaf-b639-45e2-b02a-e3f6e8494ce2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:24.328808 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b923aaf-b639-45e2-b02a-e3f6e8494ce2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:24.329309 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b923aaf-b639-45e2-b02a-e3f6e8494ce2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:24.329753 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b923aaf-b639-45e2-b02a-e3f6e8494ce2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:24.330505 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b923aaf-b639-45e2-b02a-e3f6e8494ce2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:24.331035 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b923aaf-b639-45e2-b02a-e3f6e8494ce2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:24.331467 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6b923aaf-b639-45e2-b02a-e3f6e8494ce2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:24.369686 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6b923aaf-b639-45e2-b02a-e3f6e8494ce2 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079399 Aug 29 23:58:24.370655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 436/885] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:24 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:24.573816 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:24.574521 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:24.581387 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:24.581871 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:24.582300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:24.583037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:24.583479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:24.583895 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:24.780203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:24.793821 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:24.795379 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:24.796882 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1a367a5f-530a-4610-9b3a-72bc6b2994fb tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.227576 Aug 29 23:58:24.797624 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 450/886] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:24 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:25.392299 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c01c5ae2-a635-41e5-b7e4-9180c112c53f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:25.395924 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c01c5ae2-a635-41e5-b7e4-9180c112c53f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:25.405399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c01c5ae2-a635-41e5-b7e4-9180c112c53f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:25.406328 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c01c5ae2-a635-41e5-b7e4-9180c112c53f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:25.406867 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c01c5ae2-a635-41e5-b7e4-9180c112c53f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:25.407673 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c01c5ae2-a635-41e5-b7e4-9180c112c53f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:25.408220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c01c5ae2-a635-41e5-b7e4-9180c112c53f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:25.408726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c01c5ae2-a635-41e5-b7e4-9180c112c53f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:25.456258 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c01c5ae2-a635-41e5-b7e4-9180c112c53f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073728 Aug 29 23:58:25.457990 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 437/887] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:25 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:25.823083 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:25.823907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:25.830027 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:25.830539 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:25.830970 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:25.831820 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:25.832299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:25.832747 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:25.995487 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:26.011079 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:26.014712 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:26.019705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ea870f0d-6b63-4097-9e69-3b0bd9b03bf0 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.200984 Aug 29 23:58:26.038471 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 451/888] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:25 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:26.478882 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ef615e35-4585-4fe2-917a-cae627c4e1e1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:26.481990 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ef615e35-4585-4fe2-917a-cae627c4e1e1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:26.488329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ef615e35-4585-4fe2-917a-cae627c4e1e1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:26.488800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ef615e35-4585-4fe2-917a-cae627c4e1e1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:26.489227 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ef615e35-4585-4fe2-917a-cae627c4e1e1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:26.490024 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ef615e35-4585-4fe2-917a-cae627c4e1e1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:26.490569 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ef615e35-4585-4fe2-917a-cae627c4e1e1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:26.491009 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ef615e35-4585-4fe2-917a-cae627c4e1e1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:26.530782 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ef615e35-4585-4fe2-917a-cae627c4e1e1 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058029 Aug 29 23:58:26.531355 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 438/889] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:26 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:26.541738 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1799228802", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-406797152", "security_groups": [{"name": "tempest-secgroup-smoke-1075183352"}], "block_device_mapping_v2": [{"uuid": "7c4fb718-ff9e-41b0-b390-22688f69045a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b98748d9-f76e-40ff-a76f-dd71e522597e"}]}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:26.676777 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] validate_networks() for [('b98748d9-f76e-40ff-a76f-dd71e522597e', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:58:27.061399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:27.062124 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:27.069471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.069993 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.070532 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.071192 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.072265 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.072638 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.132231 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:58:27.132732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:58:27.133095 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:58:27.133491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:58:27.133891 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:58:27.146670 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.147070 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.147901 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.149334 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.151355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.152116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.179149 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Getting quotas for project c78ff4cbc0994af8855b1ac67cb281fe. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:58:27.184680 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Getting quotas for user 1e63436f5691431d802706a8d5a6df7f and project c78ff4cbc0994af8855b1ac67cb281fe. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:58:27.235673 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:27.245272 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:27.246762 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:27.247956 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0038afd1-66b8-49a0-b93e-88b17fd23efa tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.191041 Aug 29 23:58:27.248884 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 439/890] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:27 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:27.271847 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:58:27.276644 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c4fb718-ff9e-41b0-b390-22688f69045a',volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:58:27.544130 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3adae517-8156-4659-a4c2-94630ac19615 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:27.546297 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3adae517-8156-4659-a4c2-94630ac19615 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:27.552984 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3adae517-8156-4659-a4c2-94630ac19615 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.553464 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3adae517-8156-4659-a4c2-94630ac19615 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.553904 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3adae517-8156-4659-a4c2-94630ac19615 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.555269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3adae517-8156-4659-a4c2-94630ac19615 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:27.555269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3adae517-8156-4659-a4c2-94630ac19615 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:27.555526 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3adae517-8156-4659-a4c2-94630ac19615 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:27.589404 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3adae517-8156-4659-a4c2-94630ac19615 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049998 Aug 29 23:58:27.589989 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 440/891] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:27 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:58:27.737865 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e85fdf8e-a2df-4099-89d9-7149355b9b50 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.200614 Aug 29 23:58:27.739129 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 452/892] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Aug 29 23:58:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:58:27.758189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e157c817-654d-4b28-bae3-4e07528a0449 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:27.759668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e157c817-654d-4b28-bae3-4e07528a0449 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:27.821327 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e157c817-654d-4b28-bae3-4e07528a0449 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:27.828696 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e157c817-654d-4b28-bae3-4e07528a0449 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1094 microversion: 2.1 time: 0.077749 Aug 29 23:58:27.829284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 441/893] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:27 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:28.272201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:28.272810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:28.280632 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:28.281323 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:28.281547 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:28.282263 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:28.282801 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:28.283167 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:28.447836 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:28.456600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:28.458113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:28.459322 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6e57c735-def7-4c9c-bb16-1bed397f255d tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.191385 Aug 29 23:58:28.459894 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 453/894] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:28 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:28.602080 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-bfc457b4-7af4-4a3c-8a60-a5150585a72d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:28.605038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-bfc457b4-7af4-4a3c-8a60-a5150585a72d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:28.613778 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bfc457b4-7af4-4a3c-8a60-a5150585a72d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:28.614563 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bfc457b4-7af4-4a3c-8a60-a5150585a72d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:28.615281 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bfc457b4-7af4-4a3c-8a60-a5150585a72d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:28.616117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bfc457b4-7af4-4a3c-8a60-a5150585a72d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:28.616771 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bfc457b4-7af4-4a3c-8a60-a5150585a72d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:28.617309 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bfc457b4-7af4-4a3c-8a60-a5150585a72d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:28.666374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-bfc457b4-7af4-4a3c-8a60-a5150585a72d tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067528 Aug 29 23:58:28.671655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 442/895] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:28 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:28.850832 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9e91c869-c62c-459c-8641-98d3fc46ec22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:28.851611 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9e91c869-c62c-459c-8641-98d3fc46ec22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:28.907477 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9e91c869-c62c-459c-8641-98d3fc46ec22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:28.914658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9e91c869-c62c-459c-8641-98d3fc46ec22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1094 microversion: 2.1 time: 0.068227 Aug 29 23:58:28.915289 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 454/896] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:28 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:29.484131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:29.484652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:29.490777 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.491258 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.491687 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.492496 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.492938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.493355 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.662499 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:29.671307 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:29.672767 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:29.674005 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3c9b5b92-4fb6-47b6-a781-c984865b9aa2 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.194237 Aug 29 23:58:29.674605 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 443/897] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:29 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:29.683232 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-84fedb64-c66b-4585-9ee7-01d8f7d0a27a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:29.687352 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-84fedb64-c66b-4585-9ee7-01d8f7d0a27a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:29.699278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84fedb64-c66b-4585-9ee7-01d8f7d0a27a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.699774 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84fedb64-c66b-4585-9ee7-01d8f7d0a27a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.700212 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84fedb64-c66b-4585-9ee7-01d8f7d0a27a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.700929 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84fedb64-c66b-4585-9ee7-01d8f7d0a27a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.701367 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84fedb64-c66b-4585-9ee7-01d8f7d0a27a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.701787 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-84fedb64-c66b-4585-9ee7-01d8f7d0a27a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.735771 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-84fedb64-c66b-4585-9ee7-01d8f7d0a27a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059850 Aug 29 23:58:29.736297 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 455/898] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Aug 29 23:58:29 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:58:29.807931 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b3149cdc-c484-449c-96c5-48680aebc2d9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:29.808441 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b3149cdc-c484-449c-96c5-48680aebc2d9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:29.814945 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b3149cdc-c484-449c-96c5-48680aebc2d9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.815427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b3149cdc-c484-449c-96c5-48680aebc2d9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.815858 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b3149cdc-c484-449c-96c5-48680aebc2d9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.816801 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b3149cdc-c484-449c-96c5-48680aebc2d9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.817178 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b3149cdc-c484-449c-96c5-48680aebc2d9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.817601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b3149cdc-c484-449c-96c5-48680aebc2d9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.848944 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b3149cdc-c484-449c-96c5-48680aebc2d9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Going to try to terminate instance {{(pid=127706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:58:29.941781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-671ce5db-0958-4b6e-ba68-9dac2a67020d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:29.942561 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-671ce5db-0958-4b6e-ba68-9dac2a67020d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:29.950154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-671ce5db-0958-4b6e-ba68-9dac2a67020d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.950684 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-671ce5db-0958-4b6e-ba68-9dac2a67020d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.951146 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-671ce5db-0958-4b6e-ba68-9dac2a67020d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:29.951897 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-671ce5db-0958-4b6e-ba68-9dac2a67020d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:29.952346 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-671ce5db-0958-4b6e-ba68-9dac2a67020d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:29.952767 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-671ce5db-0958-4b6e-ba68-9dac2a67020d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:30.020797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-671ce5db-0958-4b6e-ba68-9dac2a67020d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:30.029903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-671ce5db-0958-4b6e-ba68-9dac2a67020d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1192 microversion: 2.1 time: 0.095161 Aug 29 23:58:30.030512 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 456/899] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:29 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:30.197685 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b3149cdc-c484-449c-96c5-48680aebc2d9 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 204 len: 0 microversion: 2.1 time: 0.393270 Aug 29 23:58:30.198574 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 444/900] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:58:29 2022] DELETE /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:58:30.207903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3d27d715-87e1-48a1-ab3d-d5f3ac5b675f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:30.208706 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3d27d715-87e1-48a1-ab3d-d5f3ac5b675f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:30.215635 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3d27d715-87e1-48a1-ab3d-d5f3ac5b675f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:30.216100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3d27d715-87e1-48a1-ab3d-d5f3ac5b675f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:30.216525 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3d27d715-87e1-48a1-ab3d-d5f3ac5b675f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:30.217226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3d27d715-87e1-48a1-ab3d-d5f3ac5b675f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:30.217671 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3d27d715-87e1-48a1-ab3d-d5f3ac5b675f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:30.218087 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3d27d715-87e1-48a1-ab3d-d5f3ac5b675f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:30.395771 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3d27d715-87e1-48a1-ab3d-d5f3ac5b675f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:30.404829 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3d27d715-87e1-48a1-ab3d-d5f3ac5b675f tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1682 microversion: 2.1 time: 0.200729 Aug 29 23:58:30.405492 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 457/901] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:30 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:30.700247 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:30.701038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:30.708250 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:30.708740 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:30.709177 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:30.709885 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:30.710338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:30.710786 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:30.872164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:30.881487 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:30.882983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:30.885690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7fad0694-a74e-4735-aaa0-01bb9b2e3b61 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.190538 Aug 29 23:58:30.886289 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 445/902] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:30 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:31.062467 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0155e5a3-0138-4ff9-a4a4-84f3553cb262 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:31.063937 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0155e5a3-0138-4ff9-a4a4-84f3553cb262 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:31.070722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0155e5a3-0138-4ff9-a4a4-84f3553cb262 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:31.071218 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0155e5a3-0138-4ff9-a4a4-84f3553cb262 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:31.072359 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0155e5a3-0138-4ff9-a4a4-84f3553cb262 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:31.073044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0155e5a3-0138-4ff9-a4a4-84f3553cb262 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:31.073560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0155e5a3-0138-4ff9-a4a4-84f3553cb262 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:31.073917 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0155e5a3-0138-4ff9-a4a4-84f3553cb262 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:31.151946 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0155e5a3-0138-4ff9-a4a4-84f3553cb262 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:31.160288 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0155e5a3-0138-4ff9-a4a4-84f3553cb262 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1192 microversion: 2.1 time: 0.104687 Aug 29 23:58:31.161152 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 458/903] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:31 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:31.427142 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-65b3c1f0-f6d3-45e6-a288-7de649454fa3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:31.427754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-65b3c1f0-f6d3-45e6-a288-7de649454fa3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:31.434535 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65b3c1f0-f6d3-45e6-a288-7de649454fa3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:31.435023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65b3c1f0-f6d3-45e6-a288-7de649454fa3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:31.435457 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65b3c1f0-f6d3-45e6-a288-7de649454fa3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:31.436160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65b3c1f0-f6d3-45e6-a288-7de649454fa3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:31.436612 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65b3c1f0-f6d3-45e6-a288-7de649454fa3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:31.437030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65b3c1f0-f6d3-45e6-a288-7de649454fa3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:31.597391 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-65b3c1f0-f6d3-45e6-a288-7de649454fa3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:31.613552 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-65b3c1f0-f6d3-45e6-a288-7de649454fa3 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1682 microversion: 2.1 time: 0.190202 Aug 29 23:58:31.614173 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 446/904] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:31 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:31.914978 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:31.915675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:31.923259 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:31.923837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:31.924357 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:31.925151 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:31.925672 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:31.926172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:32.125324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:32.125324 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:32.126089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:32.126089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-78b1e33e-da8c-4692-aa51-7dd4f788a7a6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.194528 Aug 29 23:58:32.126089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 459/905] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:31 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:32.194604 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-65365ba0-dc82-4edd-8319-f040c546c4e0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:32.195177 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-65365ba0-dc82-4edd-8319-f040c546c4e0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:32.205544 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65365ba0-dc82-4edd-8319-f040c546c4e0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:32.206219 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65365ba0-dc82-4edd-8319-f040c546c4e0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:32.206821 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65365ba0-dc82-4edd-8319-f040c546c4e0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:32.207658 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65365ba0-dc82-4edd-8319-f040c546c4e0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:32.208323 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65365ba0-dc82-4edd-8319-f040c546c4e0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:32.208847 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-65365ba0-dc82-4edd-8319-f040c546c4e0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:32.302905 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-65365ba0-dc82-4edd-8319-f040c546c4e0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:32.318844 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-65365ba0-dc82-4edd-8319-f040c546c4e0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1192 microversion: 2.1 time: 0.127754 Aug 29 23:58:32.319478 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 447/906] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:32 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1192 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:32.636793 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3910bc75-fb22-47d6-b1bc-8d553117aa29 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:32.637428 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3910bc75-fb22-47d6-b1bc-8d553117aa29 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:32.643909 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3910bc75-fb22-47d6-b1bc-8d553117aa29 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:32.647488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3910bc75-fb22-47d6-b1bc-8d553117aa29 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:32.647488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3910bc75-fb22-47d6-b1bc-8d553117aa29 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:32.647488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3910bc75-fb22-47d6-b1bc-8d553117aa29 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:32.647488 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3910bc75-fb22-47d6-b1bc-8d553117aa29 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:32.647912 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3910bc75-fb22-47d6-b1bc-8d553117aa29 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:32.794885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3910bc75-fb22-47d6-b1bc-8d553117aa29 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:32.805501 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3910bc75-fb22-47d6-b1bc-8d553117aa29 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1682 microversion: 2.1 time: 0.173054 Aug 29 23:58:32.806389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 460/907] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:32 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:33.147320 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:33.148019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:33.155166 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.158805 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.158805 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:33.158805 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.158805 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.159362 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:33.301575 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:33.311656 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:33.313192 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:33.314559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-53cdefb6-8032-4fa8-bd78-0445228766a1 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.171159 Aug 29 23:58:33.319289 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 448/908] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:33 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:33.342489 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3fcba48b-3bc0-4ee7-a6d4-eb6beea38056 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:33.343138 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3fcba48b-3bc0-4ee7-a6d4-eb6beea38056 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:33.350914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fcba48b-3bc0-4ee7-a6d4-eb6beea38056 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.351404 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fcba48b-3bc0-4ee7-a6d4-eb6beea38056 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.351852 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fcba48b-3bc0-4ee7-a6d4-eb6beea38056 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:33.352561 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fcba48b-3bc0-4ee7-a6d4-eb6beea38056 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.353095 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fcba48b-3bc0-4ee7-a6d4-eb6beea38056 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.353573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3fcba48b-3bc0-4ee7-a6d4-eb6beea38056 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:33.439388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3fcba48b-3bc0-4ee7-a6d4-eb6beea38056 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:33.447957 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3fcba48b-3bc0-4ee7-a6d4-eb6beea38056 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1192 microversion: 2.1 time: 0.110767 Aug 29 23:58:33.448438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 461/909] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:33 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:33.827139 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a213f585-606e-4d26-b348-e32421d08f80 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:33.827759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a213f585-606e-4d26-b348-e32421d08f80 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:33.834475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a213f585-606e-4d26-b348-e32421d08f80 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.834974 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a213f585-606e-4d26-b348-e32421d08f80 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.835551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a213f585-606e-4d26-b348-e32421d08f80 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:33.836268 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a213f585-606e-4d26-b348-e32421d08f80 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:33.836727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a213f585-606e-4d26-b348-e32421d08f80 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:33.837152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a213f585-606e-4d26-b348-e32421d08f80 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:34.006228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a213f585-606e-4d26-b348-e32421d08f80 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:34.017993 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a213f585-606e-4d26-b348-e32421d08f80 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1682 microversion: 2.1 time: 0.195460 Aug 29 23:58:34.018579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 449/910] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:33 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:34.340307 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:34.340989 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:34.347852 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:34.348516 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:34.348752 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:34.349450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:34.349893 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:34.350304 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:34.481603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3df46bcc-21c3-4322-8e5e-c0c5f0c9420a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:34.482509 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-3df46bcc-21c3-4322-8e5e-c0c5f0c9420a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:34.491814 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3df46bcc-21c3-4322-8e5e-c0c5f0c9420a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:34.492626 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3df46bcc-21c3-4322-8e5e-c0c5f0c9420a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:34.493431 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3df46bcc-21c3-4322-8e5e-c0c5f0c9420a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:34.494840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3df46bcc-21c3-4322-8e5e-c0c5f0c9420a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:34.495637 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3df46bcc-21c3-4322-8e5e-c0c5f0c9420a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:34.496296 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-3df46bcc-21c3-4322-8e5e-c0c5f0c9420a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:34.509227 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:34.525180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:34.529773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:34.534910 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-53267b4a-b66c-40e9-999a-668d8617bbe7 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.196483 Aug 29 23:58:34.535988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 462/911] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:34 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:34.582548 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-3df46bcc-21c3-4322-8e5e-c0c5f0c9420a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:34.591932 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3df46bcc-21c3-4322-8e5e-c0c5f0c9420a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1192 microversion: 2.1 time: 0.114261 Aug 29 23:58:34.592442 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 450/912] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:34 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1192 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:35.042347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-39c7b608-d74b-4e57-89d6-5cbd9f198f89 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:35.042985 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-39c7b608-d74b-4e57-89d6-5cbd9f198f89 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:35.049529 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39c7b608-d74b-4e57-89d6-5cbd9f198f89 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.050026 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39c7b608-d74b-4e57-89d6-5cbd9f198f89 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.050490 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39c7b608-d74b-4e57-89d6-5cbd9f198f89 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.051207 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39c7b608-d74b-4e57-89d6-5cbd9f198f89 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.051658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39c7b608-d74b-4e57-89d6-5cbd9f198f89 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.052083 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39c7b608-d74b-4e57-89d6-5cbd9f198f89 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.056751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:35.201660 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-39c7b608-d74b-4e57-89d6-5cbd9f198f89 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:35.211631 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-39c7b608-d74b-4e57-89d6-5cbd9f198f89 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1682 microversion: 2.1 time: 0.173008 Aug 29 23:58:35.212226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 463/913] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:35 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:35.562618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:35.563441 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:35.570198 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.570725 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.571165 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.571874 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.572938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.573363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.578002 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:35.615866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-16cbda12-f159-407e-80e6-d2b79aba3a3e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:35.616834 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-16cbda12-f159-407e-80e6-d2b79aba3a3e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:35.624221 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16cbda12-f159-407e-80e6-d2b79aba3a3e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.624721 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16cbda12-f159-407e-80e6-d2b79aba3a3e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.625153 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16cbda12-f159-407e-80e6-d2b79aba3a3e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.626177 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16cbda12-f159-407e-80e6-d2b79aba3a3e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:35.626326 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16cbda12-f159-407e-80e6-d2b79aba3a3e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:35.626778 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-16cbda12-f159-407e-80e6-d2b79aba3a3e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:35.732533 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-16cbda12-f159-407e-80e6-d2b79aba3a3e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:35.740449 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-16cbda12-f159-407e-80e6-d2b79aba3a3e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1192 microversion: 2.1 time: 0.128314 Aug 29 23:58:35.741046 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 464/914] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:35 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1192 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:35.775949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:35.784857 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:35.786368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:35.787607 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7eecd773-9ee7-498f-a891-f7fb4ffa48ee tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.229232 Aug 29 23:58:35.788174 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 451/915] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:35 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:36.210595 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-15ea86a6-c73a-4877-85ad-25a657964946 req-d8ff274d-1ccf-40f0-b89e-984be7703e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a5a820-1da2-47e6-b6e9-6586034c7fcf", "name": "network-vif-plugged", "status": "completed", "tag": "92bd74c9-1028-4a8d-a703-f5c8f8637fc5"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:36.233060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-15ea86a6-c73a-4877-85ad-25a657964946 req-d8ff274d-1ccf-40f0-b89e-984be7703e5c service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:36.233423 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-15ea86a6-c73a-4877-85ad-25a657964946 req-d8ff274d-1ccf-40f0-b89e-984be7703e5c service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:36.233983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-15ea86a6-c73a-4877-85ad-25a657964946 req-d8ff274d-1ccf-40f0-b89e-984be7703e5c service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:36.243516 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f310f177-c674-44d6-98b1-31f074975821 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:36.245707 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f310f177-c674-44d6-98b1-31f074975821 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:36.252028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-15ea86a6-c73a-4877-85ad-25a657964946 req-d8ff274d-1ccf-40f0-b89e-984be7703e5c service nova] Creating event network-vif-plugged:92bd74c9-1028-4a8d-a703-f5c8f8637fc5 for instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf on hv-cinder-85427 Aug 29 23:58:36.257303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f310f177-c674-44d6-98b1-31f074975821 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:36.258189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f310f177-c674-44d6-98b1-31f074975821 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:36.258959 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f310f177-c674-44d6-98b1-31f074975821 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:36.261287 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f310f177-c674-44d6-98b1-31f074975821 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:36.263085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f310f177-c674-44d6-98b1-31f074975821 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:36.263085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f310f177-c674-44d6-98b1-31f074975821 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:36.263333 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-15ea86a6-c73a-4877-85ad-25a657964946 req-d8ff274d-1ccf-40f0-b89e-984be7703e5c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057436 Aug 29 23:58:36.264819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 465/916] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:36.767416 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-37151aa1-e684-4206-800d-6a1356c091c3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:36.778280 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-37151aa1-e684-4206-800d-6a1356c091c3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:36.781456 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37151aa1-e684-4206-800d-6a1356c091c3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:36.782382 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37151aa1-e684-4206-800d-6a1356c091c3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:36.783115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37151aa1-e684-4206-800d-6a1356c091c3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:36.784292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37151aa1-e684-4206-800d-6a1356c091c3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:36.785039 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37151aa1-e684-4206-800d-6a1356c091c3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:36.785533 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-37151aa1-e684-4206-800d-6a1356c091c3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:36.925866 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f310f177-c674-44d6-98b1-31f074975821 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:36.949278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-37151aa1-e684-4206-800d-6a1356c091c3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:36.964235 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f310f177-c674-44d6-98b1-31f074975821 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1682 microversion: 2.1 time: 0.727947 Aug 29 23:58:36.966572 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 452/917] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:36 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1682 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:36.973361 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-37151aa1-e684-4206-800d-6a1356c091c3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1200 microversion: 2.1 time: 0.213483 Aug 29 23:58:36.976869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:36.978023 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:36.980457 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 466/918] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:36 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1200 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:36.989583 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:36.990477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:36.990673 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:36.991636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:36.992222 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:36.992619 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:37.395844 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:37.416696 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:37.422131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:37.423020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-fe7c916c-4797-4ebb-a313-1fcb5366ce4c tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.453712 Aug 29 23:58:37.423681 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 453/919] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:36 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:37.986947 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-20eb72e2-d6b6-47a0-813b-90da02605af0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:37.987548 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-20eb72e2-d6b6-47a0-813b-90da02605af0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:37.989655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:37.998521 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8cf9a4a6-71d0-4fdb-9b9e-e70da395c120 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:37.999885 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8cf9a4a6-71d0-4fdb-9b9e-e70da395c120 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:38.002496 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:38.009494 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20eb72e2-d6b6-47a0-813b-90da02605af0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:38.010948 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20eb72e2-d6b6-47a0-813b-90da02605af0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:38.013373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20eb72e2-d6b6-47a0-813b-90da02605af0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:38.014935 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20eb72e2-d6b6-47a0-813b-90da02605af0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:38.015795 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20eb72e2-d6b6-47a0-813b-90da02605af0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:38.016408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-20eb72e2-d6b6-47a0-813b-90da02605af0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:38.027738 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8cf9a4a6-71d0-4fdb-9b9e-e70da395c120 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:38.029515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8cf9a4a6-71d0-4fdb-9b9e-e70da395c120 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:38.031168 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8cf9a4a6-71d0-4fdb-9b9e-e70da395c120 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:38.032163 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8cf9a4a6-71d0-4fdb-9b9e-e70da395c120 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:38.037873 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8cf9a4a6-71d0-4fdb-9b9e-e70da395c120 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:38.040768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8cf9a4a6-71d0-4fdb-9b9e-e70da395c120 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:38.231313 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-20eb72e2-d6b6-47a0-813b-90da02605af0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:38.248683 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-20eb72e2-d6b6-47a0-813b-90da02605af0 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1614 microversion: 2.1 time: 0.266055 Aug 29 23:58:38.266622 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 467/920] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:37 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1614 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:38.452365 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:38.455230 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:38.479560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:38.486176 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:38.486176 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:38.486176 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:38.487620 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:38.490256 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:38.531335 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8cf9a4a6-71d0-4fdb-9b9e-e70da395c120 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:38.555649 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8cf9a4a6-71d0-4fdb-9b9e-e70da395c120 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1278 microversion: 2.1 time: 0.561409 Aug 29 23:58:38.562807 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 454/921] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:37 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1278 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:38.597657 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-be484566-2cd3-441b-8de4-5164688c9b29 req-0ac7187c-c53b-4e8e-9fe3-9a66cfd9424b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3a4eed7-3b9b-45e9-9a5f-e022b5e59825", "name": "network-vif-deleted", "tag": "d3c7c9a6-8c48-452c-bdc9-84311c5e0ebb"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:38.648202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-be484566-2cd3-441b-8de4-5164688c9b29 req-0ac7187c-c53b-4e8e-9fe3-9a66cfd9424b service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:38.648810 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-be484566-2cd3-441b-8de4-5164688c9b29 req-0ac7187c-c53b-4e8e-9fe3-9a66cfd9424b service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:38.664791 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-be484566-2cd3-441b-8de4-5164688c9b29 req-0ac7187c-c53b-4e8e-9fe3-9a66cfd9424b service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:38.690120 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-be484566-2cd3-441b-8de4-5164688c9b29 req-0ac7187c-c53b-4e8e-9fe3-9a66cfd9424b service nova] Creating event network-vif-deleted:d3c7c9a6-8c48-452c-bdc9-84311c5e0ebb for instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 on hv-cinder-85427 Aug 29 23:58:38.705702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-be484566-2cd3-441b-8de4-5164688c9b29 req-0ac7187c-c53b-4e8e-9fe3-9a66cfd9424b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118250 Aug 29 23:58:38.712712 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 455/922] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:38.787936 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:38.800011 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:38.802189 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:38.804603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a7e1338a-8211-4250-bb47-df93a5689857 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.359298 Aug 29 23:58:38.820104 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 468/923] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:38 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 23:58:39.300985 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:39.305533 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:39.319056 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=8 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:39.323194 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.324531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.325885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:39.328231 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.329600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.331171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:39.425828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.426701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.427477 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:39.428353 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lazy-loading 'fault' on Instance uuid a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:58:39.492320 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-4dd86fb3-47a6-430b-b5c0-d6661b9e09e3 req-79b19db2-98bf-4448-962a-8bd25a9d5f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b660d30-8ce5-48f3-9337-2dbcd3c62e05", "tag": "3a779311-29d6-4a4e-8a36-b80f881603ea"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:39.506289 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-4dd86fb3-47a6-430b-b5c0-d6661b9e09e3 req-79b19db2-98bf-4448-962a-8bd25a9d5f7c service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.507137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-4dd86fb3-47a6-430b-b5c0-d6661b9e09e3 req-79b19db2-98bf-4448-962a-8bd25a9d5f7c service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.507559 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-4dd86fb3-47a6-430b-b5c0-d6661b9e09e3 req-79b19db2-98bf-4448-962a-8bd25a9d5f7c service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:39.510305 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ef7ee27c3948ac9df1ff94ce24618e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d82515633f4c2faa34d3225a6f26a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:39.522712 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-4dd86fb3-47a6-430b-b5c0-d6661b9e09e3 req-79b19db2-98bf-4448-962a-8bd25a9d5f7c service nova] Creating event network-changed:3a779311-29d6-4a4e-8a36-b80f881603ea for instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 on hv-cinder-85427 Aug 29 23:58:39.526539 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a655fa30-aa68-44e7-a66b-da16742c9247 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 200 len: 1332 microversion: 2.1 time: 0.242862 Aug 29 23:58:39.527410 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 469/924] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:39 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 1332 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:39.550127 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-4dd86fb3-47a6-430b-b5c0-d6661b9e09e3 req-79b19db2-98bf-4448-962a-8bd25a9d5f7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.311342 Aug 29 23:58:39.550127 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 456/925] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:58:39.583453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-946b936c-2007-4ab5-b2a3-564b0edee6dc tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:39.584257 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-946b936c-2007-4ab5-b2a3-564b0edee6dc tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:39.594501 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-946b936c-2007-4ab5-b2a3-564b0edee6dc tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.595127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-946b936c-2007-4ab5-b2a3-564b0edee6dc tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.595905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-946b936c-2007-4ab5-b2a3-564b0edee6dc tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:39.596712 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-946b936c-2007-4ab5-b2a3-564b0edee6dc tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.597265 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-946b936c-2007-4ab5-b2a3-564b0edee6dc tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.597755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-946b936c-2007-4ab5-b2a3-564b0edee6dc tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:39.798180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-946b936c-2007-4ab5-b2a3-564b0edee6dc tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:39.809342 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-946b936c-2007-4ab5-b2a3-564b0edee6dc tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.231359 Aug 29 23:58:39.817554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 470/926] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:39 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:39.840161 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:39.843053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:39.860048 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.861072 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.861848 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:39.863696 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:39.865005 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:39.866225 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:40.211613 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:40.249868 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:40.261879 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:40.264428 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-444f996a-09c1-4d4c-9cfa-c7df97dd5ee6 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1729 microversion: 2.20 time: 0.431503 Aug 29 23:58:40.266876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 457/927] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:39 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1729 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:40.564237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:40.565295 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:40.567541 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:40.574766 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:40.576412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:40.576412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:40.577182 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:40.577752 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:40.578182 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:40.600396 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 HTTP/1.1 Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:58:40.603916 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:40.605604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'a3a4eed7-3b9b-45e9-9a5f-e022b5e59825'} Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:40.606689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:40.608294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:40.609807 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:40.609807 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8af38cd7-2f0e-485c-81ad-5434cd4c2495 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 404 len: 111 microversion: 2.1 time: 0.052307 Aug 29 23:58:40.609807 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 471/928] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:40 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:58:40.620900 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-94803f7e-afca-428a-80df-c9cce0f7c8f6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '.version_select at 0x7fabbdd1cc10>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:40.772882 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-94803f7e-afca-428a-80df-c9cce0f7c8f6 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270248252" status: 202 len: 0 microversion: 2.1 time: 0.158393 Aug 29 23:58:40.773483 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 458/929] 10.222.0.58 () {58 vars in 1221 bytes} [Mon Aug 29 23:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270248252 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:58:40.861689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c54da7ad-fa88-4c9c-8d4f-4c358faacb67 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:40.862565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c54da7ad-fa88-4c9c-8d4f-4c358faacb67 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:40.871173 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c54da7ad-fa88-4c9c-8d4f-4c358faacb67 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:40.873481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c54da7ad-fa88-4c9c-8d4f-4c358faacb67 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:40.873481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c54da7ad-fa88-4c9c-8d4f-4c358faacb67 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:40.873481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c54da7ad-fa88-4c9c-8d4f-4c358faacb67 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:40.873481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c54da7ad-fa88-4c9c-8d4f-4c358faacb67 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:40.873902 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c54da7ad-fa88-4c9c-8d4f-4c358faacb67 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:41.065569 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c54da7ad-fa88-4c9c-8d4f-4c358faacb67 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:41.079043 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c54da7ad-fa88-4c9c-8d4f-4c358faacb67 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.221598 Aug 29 23:58:41.079948 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 472/930] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:40 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:41.291616 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:41.292237 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:41.298687 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:41.299182 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:41.299818 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:41.300549 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:41.301008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:41.301654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:41.545351 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:41.556200 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:41.558967 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:41.561295 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f814ddfe-c0d1-4544-ae64-1e92790d077b tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1716 microversion: 2.20 time: 0.274586 Aug 29 23:58:41.562112 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 459/931] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:58:41 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1716 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:58:42.103989 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0c08bee3-6c50-4c23-85e2-d8d2c0d1cfcb tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:42.104702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0c08bee3-6c50-4c23-85e2-d8d2c0d1cfcb tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:42.111637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c08bee3-6c50-4c23-85e2-d8d2c0d1cfcb tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:42.112125 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c08bee3-6c50-4c23-85e2-d8d2c0d1cfcb tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:42.112561 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c08bee3-6c50-4c23-85e2-d8d2c0d1cfcb tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:42.113268 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c08bee3-6c50-4c23-85e2-d8d2c0d1cfcb tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:42.113760 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c08bee3-6c50-4c23-85e2-d8d2c0d1cfcb tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:42.114572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0c08bee3-6c50-4c23-85e2-d8d2c0d1cfcb tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:42.274211 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0c08bee3-6c50-4c23-85e2-d8d2c0d1cfcb tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:42.284429 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0c08bee3-6c50-4c23-85e2-d8d2c0d1cfcb tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.185263 Aug 29 23:58:42.284966 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 473/932] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:42 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:43.305357 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-40507258-3dab-4f36-b86c-7b7bb6fc599e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:43.306329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-40507258-3dab-4f36-b86c-7b7bb6fc599e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:43.314049 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40507258-3dab-4f36-b86c-7b7bb6fc599e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:43.314582 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40507258-3dab-4f36-b86c-7b7bb6fc599e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:43.315018 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40507258-3dab-4f36-b86c-7b7bb6fc599e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:43.315718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40507258-3dab-4f36-b86c-7b7bb6fc599e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:43.316369 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40507258-3dab-4f36-b86c-7b7bb6fc599e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:43.316573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-40507258-3dab-4f36-b86c-7b7bb6fc599e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:43.343915 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:43.350573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:43.357822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:43.358472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:43.358773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:43.359486 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:43.360113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:43.360540 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:43.375993 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: DELETE /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 HTTP/1.1 Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:58:43.377566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:43.379204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'a3a4eed7-3b9b-45e9-9a5f-e022b5e59825'} Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:43.380302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:43.381523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:43.383380 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:43.383380 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1f64975e-503d-41d9-9dc1-dcebdf63d871 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 404 len: 111 microversion: 2.1 time: 0.039109 Aug 29 23:58:43.383380 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 474/933] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:58:43 2022] DELETE /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:43.388676 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:43.389294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: a3a4eed7-3b9b-45e9-9a5f-e022b5e59825] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:43.395823 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:43.396316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:43.396749 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:43.397497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:43.397948 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:43.398483 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:43.413964 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 HTTP/1.1 Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:58:43.415554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:43.417299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'a3a4eed7-3b9b-45e9-9a5f-e022b5e59825'} Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:43.418118 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. Aug 29 23:58:43.419735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:43.421893 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:43.421893 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a447d77e-7769-4bfa-9530-88f2fabdb348 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825" status: 404 len: 111 microversion: 2.1 time: 0.033246 Aug 29 23:58:43.421893 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 475/934] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:43 2022] GET /compute/v2.1/servers/a3a4eed7-3b9b-45e9-9a5f-e022b5e59825 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:43.475046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-40507258-3dab-4f36-b86c-7b7bb6fc599e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:43.483198 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-40507258-3dab-4f36-b86c-7b7bb6fc599e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.181748 Aug 29 23:58:43.484024 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 460/935] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:43 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:44.503889 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b74b56ee-a430-4d8e-87ef-340aff4f847f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:44.504499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b74b56ee-a430-4d8e-87ef-340aff4f847f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:44.511588 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b74b56ee-a430-4d8e-87ef-340aff4f847f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.512071 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b74b56ee-a430-4d8e-87ef-340aff4f847f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.512498 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b74b56ee-a430-4d8e-87ef-340aff4f847f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.513192 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b74b56ee-a430-4d8e-87ef-340aff4f847f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.513633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b74b56ee-a430-4d8e-87ef-340aff4f847f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.514044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b74b56ee-a430-4d8e-87ef-340aff4f847f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.654259 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b74b56ee-a430-4d8e-87ef-340aff4f847f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:44.668812 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b74b56ee-a430-4d8e-87ef-340aff4f847f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.168367 Aug 29 23:58:44.669846 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 476/936] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:44 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:44.785396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:44.785903 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:44.793221 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.793708 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.794149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.794881 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.795339 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.795763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.810014 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: DELETE /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 HTTP/1.1 Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:58:44.811752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:58:44.813306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '03f0e15f-3470-4cba-a00a-4f282d3ddfd3'} Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:44.814214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:58:44.815710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.817202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:44.817202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b8e8916d-4465-4a46-ac83-ab136f33ae5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 404 len: 111 microversion: 2.1 time: 0.031760 Aug 29 23:58:44.817202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 461/937] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:58:44 2022] DELETE /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:44.821730 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:44.822895 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 03f0e15f-3470-4cba-a00a-4f282d3ddfd3] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:44.828987 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.829475 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.829926 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.830660 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.831107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.831532 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.846265 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 HTTP/1.1 Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:58:44.847837 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:58:44.849319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '03f0e15f-3470-4cba-a00a-4f282d3ddfd3'} Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:44.850252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. Aug 29 23:58:44.851792 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.853164 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance 03f0e15f-3470-4cba-a00a-4f282d3ddfd3 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:44.853164 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b2eec2ba-69aa-4bba-835a-db6760b3e8de tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3" status: 404 len: 111 microversion: 2.1 time: 0.031334 Aug 29 23:58:44.853164 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 477/938] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:44 2022] GET /compute/v2.1/servers/03f0e15f-3470-4cba-a00a-4f282d3ddfd3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:44.858599 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:44.859375 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:44.865474 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.865949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.866384 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.867093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.867533 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.867956 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.882767 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: DELETE /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b HTTP/1.1 Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:58:44.884313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:58:44.886595 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': 'b57d3d9f-7fe5-45b7-8e55-2652336c453b'} Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:44.887325 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:58:44.888800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.890675 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:44.890675 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-94db11f6-34d7-4ebd-af96-ab40f4f58f6a tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 404 len: 111 microversion: 2.1 time: 0.031523 Aug 29 23:58:44.890675 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 462/939] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:58:44 2022] DELETE /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:44.894754 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:44.895242 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: b57d3d9f-7fe5-45b7-8e55-2652336c453b] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:44.902493 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.902990 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.903424 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.904147 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:44.904575 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:44.904992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:44.921142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b HTTP/1.1 Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:58:44.927314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:58:44.928945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'b57d3d9f-7fe5-45b7-8e55-2652336c453b'} Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:44.929822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. Aug 29 23:58:44.931364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:44.932657 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance b57d3d9f-7fe5-45b7-8e55-2652336c453b could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:44.932657 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-bc75111f-dbf0-4f62-ba9d-45d79efa8150 tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b" status: 404 len: 111 microversion: 2.1 time: 0.033334 Aug 29 23:58:44.932657 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 478/940] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:44 2022] GET /compute/v2.1/servers/b57d3d9f-7fe5-45b7-8e55-2652336c453b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:45.698726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-49ac1ee1-b67f-4e37-aa66-38c7722aa244 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:45.698726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-49ac1ee1-b67f-4e37-aa66-38c7722aa244 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:45.702894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49ac1ee1-b67f-4e37-aa66-38c7722aa244 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:45.703447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49ac1ee1-b67f-4e37-aa66-38c7722aa244 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:45.703948 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49ac1ee1-b67f-4e37-aa66-38c7722aa244 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:45.704728 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49ac1ee1-b67f-4e37-aa66-38c7722aa244 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:45.705266 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49ac1ee1-b67f-4e37-aa66-38c7722aa244 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:45.705798 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-49ac1ee1-b67f-4e37-aa66-38c7722aa244 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:45.881156 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-49ac1ee1-b67f-4e37-aa66-38c7722aa244 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:45.889738 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-49ac1ee1-b67f-4e37-aa66-38c7722aa244 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.199449 Aug 29 23:58:45.890306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 463/941] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:45 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:46.211334 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:46.214340 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:46.218930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.219417 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.219848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:46.220550 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.221300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.221726 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:46.236073 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: DELETE /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf HTTP/1.1 Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:58:46.237761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:58:46.239360 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '32036006-145d-499d-848e-16bd2f8f9abf'} Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:46.240183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:58:46.241446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:58:46.243041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:46.243041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d3bc2bb2-64be-4a71-b6c8-176019731d5c tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 404 len: 111 microversion: 2.1 time: 0.032236 Aug 29 23:58:46.243041 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 479/942] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Aug 29 23:58:46 2022] DELETE /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:58:46.249137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:46.249755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] [instance: 32036006-145d-499d-848e-16bd2f8f9abf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:46.251887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:46.256777 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.257256 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.257689 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:46.258389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.258860 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.259338 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:46.276142 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] HTTP exception thrown: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Request method failure captured: Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf HTTP/1.1 Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD5OFu_Y_fb-Sh5lTiAwhPodrG57BGdfYblWVYW-NK28b-MuaIQV-6icpf9raGygxNQstByclGU5usJwoaWkzULQHBtISaSgVeuNbukSi4nd2AFutDUXlLo7tAYn2RjBSBt7xiPG5CGN7J5Bdndh8BZ0EDaNKdaH9FcEnaQiyGOdsU Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:58:46.277834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d82515633f4c2faa34d3225a6f26a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d82515633f4c2faa34d3225a6f26a6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 80d82515633f4c2faa34d3225a6f26a6 Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819546039 Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 34ef7ee27c3948ac9df1ff94ce24618e Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-AttachVolumeNegativeTest-819546039-project Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:58:46.279271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '32036006-145d-499d-848e-16bd2f8f9abf'} Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:58:46.280019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. Aug 29 23:58:46.281329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:58:46.282676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] Returning 404 to user: Instance 32036006-145d-499d-848e-16bd2f8f9abf could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:58:46.282676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7cfdb467-bf4f-4dd6-aeb0-169c6f18a1ae tempest-AttachVolumeNegativeTest-819546039 tempest-AttachVolumeNegativeTest-819546039-project] 10.222.0.58 "GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf" status: 404 len: 111 microversion: 2.1 time: 0.034392 Aug 29 23:58:46.282676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 464/943] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:46 2022] GET /compute/v2.1/servers/32036006-145d-499d-848e-16bd2f8f9abf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:58:46.912187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-74807327-cc86-4aa6-9b17-ef9ad5b98399 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:46.913040 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-74807327-cc86-4aa6-9b17-ef9ad5b98399 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:46.920714 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74807327-cc86-4aa6-9b17-ef9ad5b98399 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.921206 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74807327-cc86-4aa6-9b17-ef9ad5b98399 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.921623 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74807327-cc86-4aa6-9b17-ef9ad5b98399 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:46.922320 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74807327-cc86-4aa6-9b17-ef9ad5b98399 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:46.922786 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74807327-cc86-4aa6-9b17-ef9ad5b98399 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:46.923207 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-74807327-cc86-4aa6-9b17-ef9ad5b98399 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:47.140845 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-74807327-cc86-4aa6-9b17-ef9ad5b98399 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:47.150796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-74807327-cc86-4aa6-9b17-ef9ad5b98399 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.242927 Aug 29 23:58:47.152315 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 480/944] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:46 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:48.174193 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a1b37f83-1373-4a86-b3aa-6683f170aeac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:48.175003 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a1b37f83-1373-4a86-b3aa-6683f170aeac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:48.183521 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1b37f83-1373-4a86-b3aa-6683f170aeac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.184010 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1b37f83-1373-4a86-b3aa-6683f170aeac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.184443 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1b37f83-1373-4a86-b3aa-6683f170aeac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.185150 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1b37f83-1373-4a86-b3aa-6683f170aeac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:48.185598 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1b37f83-1373-4a86-b3aa-6683f170aeac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:48.186020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a1b37f83-1373-4a86-b3aa-6683f170aeac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:48.448587 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a1b37f83-1373-4a86-b3aa-6683f170aeac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:48.457226 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a1b37f83-1373-4a86-b3aa-6683f170aeac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.287519 Aug 29 23:58:48.457824 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 465/945] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:48 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:49.479046 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ad7f4536-ad5e-4650-9682-92c37a73962b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:49.480979 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ad7f4536-ad5e-4650-9682-92c37a73962b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:49.492496 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ad7f4536-ad5e-4650-9682-92c37a73962b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:49.493078 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ad7f4536-ad5e-4650-9682-92c37a73962b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:49.493584 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ad7f4536-ad5e-4650-9682-92c37a73962b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:49.494543 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ad7f4536-ad5e-4650-9682-92c37a73962b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:49.495838 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ad7f4536-ad5e-4650-9682-92c37a73962b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:49.501329 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ad7f4536-ad5e-4650-9682-92c37a73962b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:49.653529 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ad7f4536-ad5e-4650-9682-92c37a73962b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:49.661700 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ad7f4536-ad5e-4650-9682-92c37a73962b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.186945 Aug 29 23:58:49.662283 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 481/946] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:49 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:50.696827 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e5b9884d-5684-4558-b328-dd9997b3467e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:50.698981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e5b9884d-5684-4558-b328-dd9997b3467e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:50.706946 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e5b9884d-5684-4558-b328-dd9997b3467e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:50.707692 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e5b9884d-5684-4558-b328-dd9997b3467e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:50.708436 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e5b9884d-5684-4558-b328-dd9997b3467e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:50.709424 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e5b9884d-5684-4558-b328-dd9997b3467e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:50.710008 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e5b9884d-5684-4558-b328-dd9997b3467e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:50.710633 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e5b9884d-5684-4558-b328-dd9997b3467e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:50.911688 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e5b9884d-5684-4558-b328-dd9997b3467e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:50.939497 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e5b9884d-5684-4558-b328-dd9997b3467e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.246737 Aug 29 23:58:50.941390 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 466/947] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:50 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:51.961169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d99c746f-0948-40e6-8c12-7e146159899a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:51.961772 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d99c746f-0948-40e6-8c12-7e146159899a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:51.968992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d99c746f-0948-40e6-8c12-7e146159899a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:51.969471 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d99c746f-0948-40e6-8c12-7e146159899a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:51.969902 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d99c746f-0948-40e6-8c12-7e146159899a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:51.970628 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d99c746f-0948-40e6-8c12-7e146159899a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:51.971358 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d99c746f-0948-40e6-8c12-7e146159899a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:51.971779 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d99c746f-0948-40e6-8c12-7e146159899a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:52.123089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d99c746f-0948-40e6-8c12-7e146159899a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:52.131768 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d99c746f-0948-40e6-8c12-7e146159899a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.174337 Aug 29 23:58:52.143130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 482/948] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:51 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:52.512289 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-eeff12d0-656e-4566-a96c-5575ad7fdee5 req-9e5508ab-3c1d-4ec3-8ee1-b4135e2f6814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b660d30-8ce5-48f3-9337-2dbcd3c62e05", "name": "network-vif-plugged", "status": "completed", "tag": "3a779311-29d6-4a4e-8a36-b80f881603ea"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:52.525046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-eeff12d0-656e-4566-a96c-5575ad7fdee5 req-9e5508ab-3c1d-4ec3-8ee1-b4135e2f6814 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:52.525524 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-eeff12d0-656e-4566-a96c-5575ad7fdee5 req-9e5508ab-3c1d-4ec3-8ee1-b4135e2f6814 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:52.527106 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-eeff12d0-656e-4566-a96c-5575ad7fdee5 req-9e5508ab-3c1d-4ec3-8ee1-b4135e2f6814 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:52.542131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-eeff12d0-656e-4566-a96c-5575ad7fdee5 req-9e5508ab-3c1d-4ec3-8ee1-b4135e2f6814 service nova] Creating event network-vif-plugged:3a779311-29d6-4a4e-8a36-b80f881603ea for instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 on hv-cinder-85427 Aug 29 23:58:52.549014 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-eeff12d0-656e-4566-a96c-5575ad7fdee5 req-9e5508ab-3c1d-4ec3-8ee1-b4135e2f6814 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040668 Aug 29 23:58:52.550018 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 467/949] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:58:53.157840 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f507b409-6c2c-43c7-ab2b-58716693d70a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:53.158374 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f507b409-6c2c-43c7-ab2b-58716693d70a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:53.164963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f507b409-6c2c-43c7-ab2b-58716693d70a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:53.165449 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f507b409-6c2c-43c7-ab2b-58716693d70a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:53.165876 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f507b409-6c2c-43c7-ab2b-58716693d70a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:53.167137 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f507b409-6c2c-43c7-ab2b-58716693d70a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:53.167579 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f507b409-6c2c-43c7-ab2b-58716693d70a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:53.167989 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f507b409-6c2c-43c7-ab2b-58716693d70a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:53.344152 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f507b409-6c2c-43c7-ab2b-58716693d70a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:53.352805 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f507b409-6c2c-43c7-ab2b-58716693d70a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.199026 Aug 29 23:58:53.353393 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 483/950] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:53 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:54.379849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8bc9a72d-5ee2-4b70-885b-bcee869236e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:54.380691 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8bc9a72d-5ee2-4b70-885b-bcee869236e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:54.388868 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bc9a72d-5ee2-4b70-885b-bcee869236e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:54.389355 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bc9a72d-5ee2-4b70-885b-bcee869236e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:54.389792 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bc9a72d-5ee2-4b70-885b-bcee869236e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.390546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bc9a72d-5ee2-4b70-885b-bcee869236e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:54.391014 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bc9a72d-5ee2-4b70-885b-bcee869236e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:54.391415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8bc9a72d-5ee2-4b70-885b-bcee869236e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:54.540639 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8bc9a72d-5ee2-4b70-885b-bcee869236e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:54.554676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8bc9a72d-5ee2-4b70-885b-bcee869236e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1266 microversion: 2.1 time: 0.182544 Aug 29 23:58:54.555791 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 468/951] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:54 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:55.576547 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-36d633fc-6d4a-4445-b11a-35f1b0e87f44 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:55.577287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-36d633fc-6d4a-4445-b11a-35f1b0e87f44 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:55.584047 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-36d633fc-6d4a-4445-b11a-35f1b0e87f44 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:55.584522 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-36d633fc-6d4a-4445-b11a-35f1b0e87f44 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:55.584947 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-36d633fc-6d4a-4445-b11a-35f1b0e87f44 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:55.585644 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-36d633fc-6d4a-4445-b11a-35f1b0e87f44 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:55.589306 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-36d633fc-6d4a-4445-b11a-35f1b0e87f44 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:55.589306 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-36d633fc-6d4a-4445-b11a-35f1b0e87f44 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:55.591334 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=100 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:58:55.741149 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-36d633fc-6d4a-4445-b11a-35f1b0e87f44 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:55.749881 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-36d633fc-6d4a-4445-b11a-35f1b0e87f44 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1453 microversion: 2.1 time: 0.177321 Aug 29 23:58:55.750481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 484/952] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:55 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:58:55.771753 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-28510d68-7afc-4786-8379-f555724a2209 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:58:55.772331 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-28510d68-7afc-4786-8379-f555724a2209 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:58:55.780091 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-28510d68-7afc-4786-8379-f555724a2209 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:55.780575 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-28510d68-7afc-4786-8379-f555724a2209 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:55.781005 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-28510d68-7afc-4786-8379-f555724a2209 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:55.781706 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-28510d68-7afc-4786-8379-f555724a2209 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:55.782205 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-28510d68-7afc-4786-8379-f555724a2209 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:55.782664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-28510d68-7afc-4786-8379-f555724a2209 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:55.945472 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-28510d68-7afc-4786-8379-f555724a2209 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:58:55.955739 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-28510d68-7afc-4786-8379-f555724a2209 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1453 microversion: 2.1 time: 0.188061 Aug 29 23:58:55.958410 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 469/953] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Aug 29 23:58:55 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:58:59.212575 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-4f679903-1ea6-47f5-b413-b68ca24caf61 req-b8d76a20-f81a-4203-96b3-b9e247134add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b660d30-8ce5-48f3-9337-2dbcd3c62e05", "tag": "3a779311-29d6-4a4e-8a36-b80f881603ea"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:58:59.224044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-4f679903-1ea6-47f5-b413-b68ca24caf61 req-b8d76a20-f81a-4203-96b3-b9e247134add service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:58:59.224453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-4f679903-1ea6-47f5-b413-b68ca24caf61 req-b8d76a20-f81a-4203-96b3-b9e247134add service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:58:59.225103 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-4f679903-1ea6-47f5-b413-b68ca24caf61 req-b8d76a20-f81a-4203-96b3-b9e247134add service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:58:59.237554 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-4f679903-1ea6-47f5-b413-b68ca24caf61 req-b8d76a20-f81a-4203-96b3-b9e247134add service nova] Creating event network-changed:3a779311-29d6-4a4e-8a36-b80f881603ea for instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 on hv-cinder-85427 Aug 29 23:58:59.243458 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-4f679903-1ea6-47f5-b413-b68ca24caf61 req-b8d76a20-f81a-4203-96b3-b9e247134add service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034846 Aug 29 23:58:59.244357 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 485/954] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:14.865986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d908ec84-1650-41ad-8a7e-e51e4538dd6a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:14.868286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d908ec84-1650-41ad-8a7e-e51e4538dd6a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:14.871540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=11 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:14.872208 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=82 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:14.877091 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d908ec84-1650-41ad-8a7e-e51e4538dd6a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:14.877579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d908ec84-1650-41ad-8a7e-e51e4538dd6a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:14.878015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d908ec84-1650-41ad-8a7e-e51e4538dd6a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:14.878745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d908ec84-1650-41ad-8a7e-e51e4538dd6a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:14.879196 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d908ec84-1650-41ad-8a7e-e51e4538dd6a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:14.879626 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d908ec84-1650-41ad-8a7e-e51e4538dd6a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:14.910815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d908ec84-1650-41ad-8a7e-e51e4538dd6a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048654 Aug 29 23:59:14.911734 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 470/955] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Aug 29 23:59:14 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:59:14.977413 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=29 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:14.978181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=6 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:14.983116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8b3c695b-fe01-4f44-841d-1ecd5c73cb09 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:14.983973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8b3c695b-fe01-4f44-841d-1ecd5c73cb09 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:14.990260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8b3c695b-fe01-4f44-841d-1ecd5c73cb09 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:14.993945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8b3c695b-fe01-4f44-841d-1ecd5c73cb09 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:14.993945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8b3c695b-fe01-4f44-841d-1ecd5c73cb09 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:14.993945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8b3c695b-fe01-4f44-841d-1ecd5c73cb09 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:14.993945 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8b3c695b-fe01-4f44-841d-1ecd5c73cb09 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:14.994562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8b3c695b-fe01-4f44-841d-1ecd5c73cb09 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:15.020145 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8b3c695b-fe01-4f44-841d-1ecd5c73cb09 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:59:15.466294 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8b3c695b-fe01-4f44-841d-1ecd5c73cb09 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "DELETE /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 204 len: 0 microversion: 2.20 time: 0.490977 Aug 29 23:59:15.466921 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 486/956] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Aug 29 23:59:14 2022] DELETE /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 23:59:15.476649 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:15.477271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:15.485224 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:15.485706 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:15.486142 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:15.486867 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:15.488659 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:15.488659 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:15.656625 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:15.665791 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:15.667298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:15.668614 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9e22d7a1-9eb0-469a-9ba8-4725a7457724 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.196974 Aug 29 23:59:15.669140 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 471/957] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:15 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:16.696965 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:16.699352 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:16.708238 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:16.708897 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:16.709373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:16.710226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:16.710756 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:16.711210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:16.873134 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:16.887673 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:16.890591 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:16.892906 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f35237b0-7b3d-41a8-9b35-50bf118d601a tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.202338 Aug 29 23:59:16.893900 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 487/958] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:16 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:17.932725 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:17.934043 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:17.944873 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:17.945623 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:17.946299 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:17.948036 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:17.949316 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:17.949997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:18.174535 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:18.196847 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:18.202019 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:18.218607 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0d6ec5cb-c60c-4617-9e05-dc0caa3b6ee4 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1722 microversion: 2.20 time: 0.287961 Aug 29 23:59:18.222660 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 472/959] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:17 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1722 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:18.602534 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-805dc9e1-c448-407d-9875-d9db8e04bf94 req-80264625-82e6-4233-ac3b-41d611c32705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a5a820-1da2-47e6-b6e9-6586034c7fcf", "name": "network-vif-deleted", "tag": "92bd74c9-1028-4a8d-a703-f5c8f8637fc5"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:18.623959 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-805dc9e1-c448-407d-9875-d9db8e04bf94 req-80264625-82e6-4233-ac3b-41d611c32705 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:18.624963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-805dc9e1-c448-407d-9875-d9db8e04bf94 req-80264625-82e6-4233-ac3b-41d611c32705 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:18.625868 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-805dc9e1-c448-407d-9875-d9db8e04bf94 req-80264625-82e6-4233-ac3b-41d611c32705 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:18.642042 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-805dc9e1-c448-407d-9875-d9db8e04bf94 req-80264625-82e6-4233-ac3b-41d611c32705 service nova] Creating event network-vif-deleted:92bd74c9-1028-4a8d-a703-f5c8f8637fc5 for instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf on hv-cinder-85427 Aug 29 23:59:18.648114 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-805dc9e1-c448-407d-9875-d9db8e04bf94 req-80264625-82e6-4233-ac3b-41d611c32705 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051544 Aug 29 23:59:18.649115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 488/960] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Aug 29 23:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:19.242230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:19.243057 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:19.252159 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:19.252618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:19.253046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:19.253758 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:19.254206 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:19.254652 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:19.301699 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:19.302741 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:19.303556 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:19.304277 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lazy-loading 'fault' on Instance uuid 37a5a820-1da2-47e6-b6e9-6586034c7fcf {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:59:19.355964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:19.369601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:19.371938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b2c6a74c29443b94d1577b39c7ce0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fd4107165644976b1d8cdbeec3c8711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:59:19.373364 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c08c5801-2b6f-4f15-9075-dee3c0b288ac tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 200 len: 1370 microversion: 2.20 time: 0.135172 Aug 29 23:59:19.374387 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 473/961] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:19 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 1370 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 23:59:20.396996 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:20.398332 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:20.406014 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:20.406553 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:20.406987 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:20.407706 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:20.408157 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:20.408566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:20.424208 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] HTTP exception thrown: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Request method failure captured: Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf HTTP/1.1 Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD9ahf4fITXYsvB7DkVxsPPZSBg88u42Xde891Stk2ZF_SftyM-VmtHlrVG-c-dgF4GJG68q8l5f05EcLDtTq5lhO__4-xNgr9qzXSPkzKg3Cv1FccN0Ad9633XTz9JzOziyBfZa76s0BLyEVRmecTDmOE72Jd1z4NFaBiqT4gLFrw Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:59:20.426018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd4107165644976b1d8cdbeec3c8711", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 90b2c6a74c29443b94d1577b39c7ce0b Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:20.428715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '37a5a820-1da2-47e6-b6e9-6586034c7fcf'} Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:20.430436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:20.433300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:20.435870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Returning 404 to user: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:20.435870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-01594374-4e76-46ce-8ca9-499775d80858 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 404 len: 111 microversion: 2.20 time: 0.035568 Aug 29 23:59:20.435870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 489/962] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:20 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:59:20.440221 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9f32b627-45a0-43e0-85d0-3692c6166291 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '.version_select at 0x7fabbdc3ab80>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:20.547505 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9f32b627-45a0-43e0-85d0-3692c6166291 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551696870" status: 204 len: 0 microversion: 2.20 time: 0.110946 Aug 29 23:59:20.548144 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 474/963] 10.222.0.58 () {60 vars in 1259 bytes} [Mon Aug 29 23:59:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551696870 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 23:59:22.756832 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:22.757379 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:22.764282 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:22.764988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:22.765424 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:22.766143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:22.766636 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:22.767055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:22.783111 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] HTTP exception thrown: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Request method failure captured: Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: DELETE /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf HTTP/1.1 Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD9ahf4fITXYsvB7DkVxsPPZSBg88u42Xde891Stk2ZF_SftyM-VmtHlrVG-c-dgF4GJG68q8l5f05EcLDtTq5lhO__4-xNgr9qzXSPkzKg3Cv1FccN0Ad9633XTz9JzOziyBfZa76s0BLyEVRmecTDmOE72Jd1z4NFaBiqT4gLFrw Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:59:22.784694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd4107165644976b1d8cdbeec3c8711", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 90b2c6a74c29443b94d1577b39c7ce0b Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:22.786810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '37a5a820-1da2-47e6-b6e9-6586034c7fcf'} Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:22.788444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:22.793030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:22.813258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Returning 404 to user: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:22.813258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9643b688-1e05-49f8-9c04-c18196327de3 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "DELETE /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 404 len: 111 microversion: 2.20 time: 0.034074 Aug 29 23:59:22.813258 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 490/964] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Aug 29 23:59:22 2022] DELETE /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:59:22.813794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:22.813794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 37a5a820-1da2-47e6-b6e9-6586034c7fcf] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:22.813794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:22.813794 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:22.814443 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:22.814443 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:22.814443 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:22.814443 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:22.828441 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] HTTP exception thrown: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Request method failure captured: Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf HTTP/1.1 Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD9ahf4fITXYsvB7DkVxsPPZSBg88u42Xde891Stk2ZF_SftyM-VmtHlrVG-c-dgF4GJG68q8l5f05EcLDtTq5lhO__4-xNgr9qzXSPkzKg3Cv1FccN0Ad9633XTz9JzOziyBfZa76s0BLyEVRmecTDmOE72Jd1z4NFaBiqT4gLFrw Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:59:22.830113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd4107165644976b1d8cdbeec3c8711", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 90b2c6a74c29443b94d1577b39c7ce0b Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:22.831745 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '37a5a820-1da2-47e6-b6e9-6586034c7fcf'} Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:22.832519 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. Aug 29 23:59:22.833724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:22.836154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Returning 404 to user: Instance 37a5a820-1da2-47e6-b6e9-6586034c7fcf could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:22.836154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-efed4e1e-5ed9-421a-80a8-4f734533ce39 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf" status: 404 len: 111 microversion: 2.20 time: 0.040217 Aug 29 23:59:22.836154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 475/965] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:22 2022] GET /compute/v2.1/servers/37a5a820-1da2-47e6-b6e9-6586034c7fcf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:59:24.188698 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:24.189472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:24.197312 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:24.197799 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:24.198823 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:24.199630 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:24.200235 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:24.200812 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:24.219423 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] HTTP exception thrown: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Request method failure captured: Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: DELETE /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c HTTP/1.1 Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVD9ahf4fITXYsvB7DkVxsPPZSBg88u42Xde891Stk2ZF_SftyM-VmtHlrVG-c-dgF4GJG68q8l5f05EcLDtTq5lhO__4-xNgr9qzXSPkzKg3Cv1FccN0Ad9633XTz9JzOziyBfZa76s0BLyEVRmecTDmOE72Jd1z4NFaBiqT4gLFrw Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:59:24.221049 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd4107165644976b1d8cdbeec3c8711", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 90b2c6a74c29443b94d1577b39c7ce0b Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:59:24.224171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '781bf4fc-f6e6-4efc-b757-5888339b6b3c'} Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:24.225637 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:59:24.228101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:24.233711 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Returning 404 to user: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:24.233711 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-66ee5c02-29eb-441d-b5c4-bf5efd769865 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "DELETE /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 404 len: 111 microversion: 2.20 time: 0.038275 Aug 29 23:59:24.233711 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 491/966] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Aug 29 23:59:24 2022] DELETE /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:59:24.234269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:24.234269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] [instance: 781bf4fc-f6e6-4efc-b757-5888339b6b3c] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:59:24.240677 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:24.241306 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:24.241636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:24.242319 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:59:24.243016 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:59:24.243477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:59:24.261405 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] HTTP exception thrown: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Request method failure captured: Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c HTTP/1.1 Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVD9ahf4fITXYsvB7DkVxsPPZSBg88u42Xde891Stk2ZF_SftyM-VmtHlrVG-c-dgF4GJG68q8l5f05EcLDtTq5lhO__4-xNgr9qzXSPkzKg3Cv1FccN0Ad9633XTz9JzOziyBfZa76s0BLyEVRmecTDmOE72Jd1z4NFaBiqT4gLFrw Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:59:24.263108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3fd4107165644976b1d8cdbeec3c8711"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3fd4107165644976b1d8cdbeec3c8711", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 3fd4107165644976b1d8cdbeec3c8711 Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1926753954 Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 90b2c6a74c29443b94d1577b39c7ce0b Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1926753954-project Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:59:24.268983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '781bf4fc-f6e6-4efc-b757-5888339b6b3c'} Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:24.269892 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. Aug 29 23:59:24.271894 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:24.273304 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] Returning 404 to user: Instance 781bf4fc-f6e6-4efc-b757-5888339b6b3c could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:24.273304 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-fd618f66-49a8-48a0-8a93-c4a7163e81f9 tempest-AttachVolumeShelveTestJSON-1926753954 tempest-AttachVolumeShelveTestJSON-1926753954-project] 10.222.0.58 "GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c" status: 404 len: 111 microversion: 2.20 time: 0.036818 Aug 29 23:59:24.273304 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 476/967] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Aug 29 23:59:24 2022] GET /compute/v2.1/servers/781bf4fc-f6e6-4efc-b757-5888339b6b3c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 23:59:31.612487 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-cfaa3f52-d96c-4e6a-9b94-1a060b3f46cd tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Action: 'create', calling method: .version_select at 0x7fabc1748040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2072085145"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:32.430989 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-cfaa3f52-d96c-4e6a-9b94-1a060b3f46cd tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.041209 Aug 29 23:59:32.431636 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 492/968] 10.222.0.58 () {60 vars in 1155 bytes} [Mon Aug 29 23:59:31 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1043 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 23:59:32.446131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c376f1d2-6993-4fcb-b17c-7573b5a1d18d tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdc3af70>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:32.514565 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c376f1d2-6993-4fcb-b17c-7573b5a1d18d tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509" status: 200 len: 345 microversion: 2.1 time: 0.072204 Aug 29 23:59:32.515474 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 477/969] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:32 2022] GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:33.534202 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-26051517-e972-49ae-bb4d-dd8b834c2700 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbde569d0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:34.102573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-26051517-e972-49ae-bb4d-dd8b834c2700 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509" status: 200 len: 346 microversion: 2.1 time: 0.569875 Aug 29 23:59:34.102573 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 493/970] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:33 2022] GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509 => generated 346 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:59:34.116630 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a94aff79-ff19-4556-95e9-857c58728d1a tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Action: 'create', calling method: .version_select at 0x7fabbdebaaf0>, body: {"snapshot": {"volume_id": "71ab1751-b7cd-4260-825f-8cc1e0610509", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2121185199"}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:59:34.237266 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:34.249073 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=30 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:34.895726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a94aff79-ff19-4556-95e9-857c58728d1a tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.775808 Aug 29 23:59:34.895726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 478/971] 10.222.0.58 () {60 vars in 1162 bytes} [Mon Aug 29 23:59:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:34.900246 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:34.902440 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:59:34.910690 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f919886f-4730-42d8-af4a-3deff56d5c46 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdcde160>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:34.942063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f919886f-4730-42d8-af4a-3deff56d5c46 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 200 len: 287 microversion: 2.1 time: 0.044107 Aug 29 23:59:34.942686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 494/972] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:34 2022] GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:34.954462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a23c61fc-ccfa-40d8-ba47-6ee0c5234a55 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdd730d0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:34.992640 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a23c61fc-ccfa-40d8-ba47-6ee0c5234a55 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037622 Aug 29 23:59:34.992640 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 479/973] 10.222.0.58 () {58 vars in 1140 bytes} [Mon Aug 29 23:59:34 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:35.000627 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5e6cd4ea-1413-4ed1-905e-967af974da61 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdcc2040>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:35.036211 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5e6cd4ea-1413-4ed1-905e-967af974da61 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 200 len: 287 microversion: 2.1 time: 0.039667 Aug 29 23:59:35.036858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 495/974] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:34 2022] GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:59:36.050625 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-12fa512f-39f3-48da-9699-2b40b3e2f741 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdebaca0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:36.081928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-12fa512f-39f3-48da-9699-2b40b3e2f741 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 200 len: 287 microversion: 2.1 time: 0.036546 Aug 29 23:59:36.082538 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 480/975] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:36 2022] GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:37.096512 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-375036d3-8701-4dfc-9180-1322bb2824e1 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbde773a0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:37.132563 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-375036d3-8701-4dfc-9180-1322bb2824e1 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 200 len: 287 microversion: 2.1 time: 0.040745 Aug 29 23:59:37.133144 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 496/976] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:37 2022] GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:38.146887 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2526bf46-636b-4d19-8ca8-a57b92be0734 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdb7e040>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:38.178175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2526bf46-636b-4d19-8ca8-a57b92be0734 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 200 len: 287 microversion: 2.1 time: 0.035662 Aug 29 23:59:38.178929 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 481/977] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:38 2022] GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:39.199598 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ca2b40f8-74ed-4b17-97e0-804b20e0bcbe tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdd96ee0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:39.232125 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ca2b40f8-74ed-4b17-97e0-804b20e0bcbe tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 200 len: 288 microversion: 2.1 time: 0.038240 Aug 29 23:59:39.232790 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 497/978] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:39 2022] GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:39.244301 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ba3a24ae-8d8b-40c5-81ef-32b9d0ab3384 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdc11e50>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:39.376402 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ba3a24ae-8d8b-40c5-81ef-32b9d0ab3384 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 202 len: 0 microversion: 2.1 time: 0.136214 Aug 29 23:59:39.378618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 482/979] 10.222.0.58 () {58 vars in 1254 bytes} [Mon Aug 29 23:59:39 2022] DELETE /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:59:39.389299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7bd860eb-4763-4806-a88f-fb0c0206c08a tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdcde1f0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:39.424617 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7bd860eb-4763-4806-a88f-fb0c0206c08a tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 200 len: 287 microversion: 2.1 time: 0.041916 Aug 29 23:59:39.425385 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 498/980] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:39 2022] GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:59:40.439053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-3c226ba1-e01b-4a42-96fe-509d11699a9c tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdc3aaf0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:40.471790 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-3c226ba1-e01b-4a42-96fe-509d11699a9c tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 200 len: 287 microversion: 2.1 time: 0.037353 Aug 29 23:59:40.472617 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 483/981] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:40 2022] GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:41.488412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-36199c46-a123-4fc9-9bf0-b4a3dcf13194 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbde77550>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:41.528338 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-36199c46-a123-4fc9-9bf0-b4a3dcf13194 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 200 len: 287 microversion: 2.1 time: 0.046883 Aug 29 23:59:41.529132 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 499/982] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:41 2022] GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:42.542375 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4cb2c515-6add-4d3e-bf79-592efc6ae094 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdcc3ee0>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.574025 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-4cb2c515-6add-4d3e-bf79-592efc6ae094 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] HTTP exception thrown: Snapshot b62c09fe-f4c1-41dd-a713-3a746520cc41 could not be found. Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4cb2c515-6add-4d3e-bf79-592efc6ae094 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Request method failure captured: Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 HTTP/1.1 Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVLj0hDiUBMcmw0erQ6igK5UphlW4_l61eMBCUgglindbBC7RP93-hR94zyN9ScG-YieYXtRMPlJjVmrkctZGXLy76icleC5Zwl_VNjErqVxaVdwqkXiswdADd8W9RZk_JFlT9XGPEgQ6mD6OQcd5RJ-sXtKtmeyu1TXxuul4wAUMb4 Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: bc4234ae4468419caa7f6860578a0602 Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:59:42.576372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc4234ae4468419caa7f6860578a0602", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: bc4234ae4468419caa7f6860578a0602 Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-VolumesSnapshotsTestJSON-1905973867-project Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 6dae8438665643beb106ac76bec1d98f Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1905973867-project Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Snapshot b62c09fe-f4c1-41dd-a713-3a746520cc41 could not be found. Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': 'b62c09fe-f4c1-41dd-a713-3a746520cc41'} Aug 29 23:59:42.578817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b62c09fe-f4c1-41dd-a713-3a746520cc41 could not be found. (HTTP 404) (Request-ID: req-3c5c65f3-74ae-4c97-a99d-b427c73235cf) Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.580255 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:42.582269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b62c09fe-f4c1-41dd-a713-3a746520cc41 could not be found. Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 23:59:42.591840 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b62c09fe-f4c1-41dd-a713-3a746520cc41 could not be found. Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b62c09fe-f4c1-41dd-a713-3a746520cc41 could not be found. Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4cb2c515-6add-4d3e-bf79-592efc6ae094 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Returning 404 to user: Snapshot b62c09fe-f4c1-41dd-a713-3a746520cc41 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:42.594690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4cb2c515-6add-4d3e-bf79-592efc6ae094 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41" status: 404 len: 111 microversion: 2.1 time: 0.040904 Aug 29 23:59:42.596464 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 484/983] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Aug 29 23:59:42 2022] GET /compute/v2.1/os-snapshots/b62c09fe-f4c1-41dd-a713-3a746520cc41 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:59:42.599742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-95d58004-676c-4aaf-882b-bd278e7a95b8 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdcde820>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.827846 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-95d58004-676c-4aaf-882b-bd278e7a95b8 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509" status: 202 len: 0 microversion: 2.1 time: 0.233517 Aug 29 23:59:42.829071 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 500/984] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Aug 29 23:59:42 2022] DELETE /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:59:42.838194 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e0e687c4-4458-4762-b991-d6f1cb8e4eb1 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdc3a310>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:42.894756 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e0e687c4-4458-4762-b991-d6f1cb8e4eb1 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509" status: 200 len: 345 microversion: 2.1 time: 0.060405 Aug 29 23:59:42.895336 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 485/985] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:42 2022] GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:59:43.911501 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f0d0c7c0-67eb-4105-ab66-bf286e3d700d tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdcc2e50>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:43.942359 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-f0d0c7c0-67eb-4105-ab66-bf286e3d700d tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] HTTP exception thrown: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f0d0c7c0-67eb-4105-ab66-bf286e3d700d tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Request method failure captured: Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509 HTTP/1.1 Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVLj0hDiUBMcmw0erQ6igK5UphlW4_l61eMBCUgglindbBC7RP93-hR94zyN9ScG-YieYXtRMPlJjVmrkctZGXLy76icleC5Zwl_VNjErqVxaVdwqkXiswdADd8W9RZk_JFlT9XGPEgQ6mD6OQcd5RJ-sXtKtmeyu1TXxuul4wAUMb4 Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: bc4234ae4468419caa7f6860578a0602 Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:59:43.944732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc4234ae4468419caa7f6860578a0602", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: bc4234ae4468419caa7f6860578a0602 Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-VolumesSnapshotsTestJSON-1905973867-project Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 6dae8438665643beb106ac76bec1d98f Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1905973867-project Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '71ab1751-b7cd-4260-825f-8cc1e0610509'} Aug 29 23:59:43.947723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. (HTTP 404) (Request-ID: req-099304d9-8270-4885-9e09-1c13a0c24fe8) Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:43.950555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:43.953063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 23:59:43.955499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f0d0c7c0-67eb-4105-ab66-bf286e3d700d tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Returning 404 to user: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f0d0c7c0-67eb-4105-ab66-bf286e3d700d tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509" status: 404 len: 109 microversion: 2.1 time: 0.040102 Aug 29 23:59:43.957835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 501/986] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:43 2022] GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:43.969869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a52aaa9f-d7cd-43fe-b649-815651e4fba7 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdeba280>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:44.003842 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-a52aaa9f-d7cd-43fe-b649-815651e4fba7 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] HTTP exception thrown: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a52aaa9f-d7cd-43fe-b649-815651e4fba7 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Request method failure captured: Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: DELETE /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509 HTTP/1.1 Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVLj0hDiUBMcmw0erQ6igK5UphlW4_l61eMBCUgglindbBC7RP93-hR94zyN9ScG-YieYXtRMPlJjVmrkctZGXLy76icleC5Zwl_VNjErqVxaVdwqkXiswdADd8W9RZk_JFlT9XGPEgQ6mD6OQcd5RJ-sXtKtmeyu1TXxuul4wAUMb4 Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: bc4234ae4468419caa7f6860578a0602 Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 29 23:59:44.005841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc4234ae4468419caa7f6860578a0602", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: bc4234ae4468419caa7f6860578a0602 Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-VolumesSnapshotsTestJSON-1905973867-project Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 6dae8438665643beb106ac76bec1d98f Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1905973867-project Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '71ab1751-b7cd-4260-825f-8cc1e0610509'} Aug 29 23:59:44.008283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. (HTTP 404) (Request-ID: req-db7baf37-8636-49a3-9808-f8bd028ae3d1) Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:44.009418 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 23:59:44.012368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 23:59:44.014992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a52aaa9f-d7cd-43fe-b649-815651e4fba7 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Returning 404 to user: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a52aaa9f-d7cd-43fe-b649-815651e4fba7 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509" status: 404 len: 109 microversion: 2.1 time: 0.043583 Aug 29 23:59:44.017507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 486/987] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Aug 29 23:59:43 2022] DELETE /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:59:44.020578 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b55d11c7-f6b4-4486-88e2-6b31183d6ff7 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Calling method '.version_select at 0x7fabbdcc2550>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:59:44.067045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-b55d11c7-f6b4-4486-88e2-6b31183d6ff7 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] HTTP exception thrown: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b55d11c7-f6b4-4486-88e2-6b31183d6ff7 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Request method failure captured: Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509 HTTP/1.1 Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVLj0hDiUBMcmw0erQ6igK5UphlW4_l61eMBCUgglindbBC7RP93-hR94zyN9ScG-YieYXtRMPlJjVmrkctZGXLy76icleC5Zwl_VNjErqVxaVdwqkXiswdADd8W9RZk_JFlT9XGPEgQ6mD6OQcd5RJ-sXtKtmeyu1TXxuul4wAUMb4 Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: bc4234ae4468419caa7f6860578a0602 Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 29 23:59:44.069044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc4234ae4468419caa7f6860578a0602"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc4234ae4468419caa7f6860578a0602", "adminURL": "http://10.222.0.58:8080"}]}] Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: bc4234ae4468419caa7f6860578a0602 Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1905973867 Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-VolumesSnapshotsTestJSON-1905973867-project Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 6dae8438665643beb106ac76bec1d98f Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1905973867-project Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '71ab1751-b7cd-4260-825f-8cc1e0610509'} Aug 29 23:59:44.073203 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. (HTTP 404) (Request-ID: req-a8a09f4a-1a7e-4461-be73-5ad50001d281) Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:44.075431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 23:59:44.078098 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 23:59:44.080243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b55d11c7-f6b4-4486-88e2-6b31183d6ff7 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] Returning 404 to user: Volume 71ab1751-b7cd-4260-825f-8cc1e0610509 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b55d11c7-f6b4-4486-88e2-6b31183d6ff7 tempest-VolumesSnapshotsTestJSON-1905973867 tempest-VolumesSnapshotsTestJSON-1905973867-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509" status: 404 len: 109 microversion: 2.1 time: 0.057306 Aug 29 23:59:44.082923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 502/988] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Aug 29 23:59:44 2022] GET /compute/v2.1/os-volumes/71ab1751-b7cd-4260-825f-8cc1e0610509 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:00:09.688045 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:00:09.689163 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Tue Aug 30 00:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.58) !!! Aug 30 00:00:09.703701 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-828798585", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452"}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:09.778020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] validate_networks() for None {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:00:10.089518 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:00:10.089956 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:00:10.090718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:00:10.091353 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:00:10.091838 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:00:10.101746 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.102462 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.102880 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.103598 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:10.104039 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:10.104458 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:10.124873 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Getting quotas for project afc6be07438a47fb9b13974bd61fbe57. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:00:10.132895 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Getting quotas for user 42a2a81700ff44c394602c9a5fac5df0 and project afc6be07438a47fb9b13974bd61fbe57. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:00:10.145481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:00:10.147822 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:00:10.284492 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0522ea71-ca28-4dfc-b1ec-86c76050e14e tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598793 Aug 30 00:00:10.292780 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 487/989] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 30 00:00:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:00:10.299450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:00:10.301565 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Tue Aug 30 00:00:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 (ip 10.222.0.58) !!! Aug 30 00:00:10.304788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-287d8121-3fe5-4716-a6a9-85ff5b6afe29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:10.305788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-287d8121-3fe5-4716-a6a9-85ff5b6afe29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:10.380526 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-287d8121-3fe5-4716-a6a9-85ff5b6afe29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:10.390476 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-287d8121-3fe5-4716-a6a9-85ff5b6afe29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1214 microversion: 2.1 time: 0.094088 Aug 30 00:00:10.391438 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 503/990] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:10 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:10.958634 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1744039667", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "networks": [{"uuid": "c9ec0f26-0bf4-4e7f-95ac-3f35cbd77e6d"}]}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:11.026262 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] validate_networks() for [('c9ec0f26-0bf4-4e7f-95ac-3f35cbd77e6d', None, None, None, None, None)] {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:00:11.412716 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9a6ba481-a859-470c-8ba0-49281e2cab30 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:11.414171 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9a6ba481-a859-470c-8ba0-49281e2cab30 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:11.436736 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:00:11.438189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:00:11.439717 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:00:11.440813 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:00:11.441893 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:00:11.461656 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.463512 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.464323 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.467373 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:11.469070 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:11.470567 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:11.491317 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9a6ba481-a859-470c-8ba0-49281e2cab30 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:11.503491 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9a6ba481-a859-470c-8ba0-49281e2cab30 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1214 microversion: 2.1 time: 0.094771 Aug 30 00:00:11.506414 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 504/991] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:11 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:11.529123 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Getting quotas for project 3771a66c80964a40805c3a9f1f51c3da. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:00:11.533872 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Getting quotas for user bf8fecbb57394e2e8f5dabfd75ac6b7c and project 3771a66c80964a40805c3a9f1f51c3da. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:00:11.546189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:00:11.548488 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:00:11.733823 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-42f211c7-d64b-4d4b-bbf1-5fa54dd9a94b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781358 Aug 30 00:00:11.734527 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 488/992] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 30 00:00:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:00:11.745571 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1a7bcdfe-4f63-421a-9500-230af8c68981 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:11.746222 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1a7bcdfe-4f63-421a-9500-230af8c68981 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:11.831723 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1a7bcdfe-4f63-421a-9500-230af8c68981 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:11.839695 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1a7bcdfe-4f63-421a-9500-230af8c68981 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1219 microversion: 2.1 time: 0.097966 Aug 30 00:00:11.840661 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 505/993] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:11 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:12.531051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8e12af1e-7f53-41ef-a104-3b86df2f55b4 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:12.531942 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8e12af1e-7f53-41ef-a104-3b86df2f55b4 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:12.538414 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8e12af1e-7f53-41ef-a104-3b86df2f55b4 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:12.538949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8e12af1e-7f53-41ef-a104-3b86df2f55b4 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:12.539395 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8e12af1e-7f53-41ef-a104-3b86df2f55b4 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:12.540135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8e12af1e-7f53-41ef-a104-3b86df2f55b4 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:12.540573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8e12af1e-7f53-41ef-a104-3b86df2f55b4 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:12.541152 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8e12af1e-7f53-41ef-a104-3b86df2f55b4 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:12.627876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8e12af1e-7f53-41ef-a104-3b86df2f55b4 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:12.640799 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8e12af1e-7f53-41ef-a104-3b86df2f55b4 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1266 microversion: 2.1 time: 0.114467 Aug 30 00:00:12.641854 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 489/994] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:12 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:12.864062 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a3f39871-6ace-40c1-9857-3e20db8df77c tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:12.864839 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a3f39871-6ace-40c1-9857-3e20db8df77c tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:12.954008 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a3f39871-6ace-40c1-9857-3e20db8df77c tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:12.961561 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a3f39871-6ace-40c1-9857-3e20db8df77c tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1219 microversion: 2.1 time: 0.103835 Aug 30 00:00:12.962150 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 506/995] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:12 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:13.667169 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2b0820d1-1528-4709-8994-5864a84fa53c tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:13.673937 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2b0820d1-1528-4709-8994-5864a84fa53c tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:13.678475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2b0820d1-1528-4709-8994-5864a84fa53c tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.679283 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2b0820d1-1528-4709-8994-5864a84fa53c tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.679991 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2b0820d1-1528-4709-8994-5864a84fa53c tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.681379 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2b0820d1-1528-4709-8994-5864a84fa53c tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.683363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2b0820d1-1528-4709-8994-5864a84fa53c tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.684461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2b0820d1-1528-4709-8994-5864a84fa53c tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.985475 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e03cf19d-de05-49df-9d51-d2e75381cf3f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:13.986580 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e03cf19d-de05-49df-9d51-d2e75381cf3f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:13.995796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e03cf19d-de05-49df-9d51-d2e75381cf3f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.996918 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e03cf19d-de05-49df-9d51-d2e75381cf3f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.997583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e03cf19d-de05-49df-9d51-d2e75381cf3f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:13.998297 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e03cf19d-de05-49df-9d51-d2e75381cf3f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:13.998780 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e03cf19d-de05-49df-9d51-d2e75381cf3f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:13.999204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e03cf19d-de05-49df-9d51-d2e75381cf3f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:14.178903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e03cf19d-de05-49df-9d51-d2e75381cf3f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:14.186057 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2b0820d1-1528-4709-8994-5864a84fa53c tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:14.187303 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e03cf19d-de05-49df-9d51-d2e75381cf3f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1215 microversion: 2.1 time: 0.207718 Aug 30 00:00:14.194473 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2b0820d1-1528-4709-8994-5864a84fa53c tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1274 microversion: 2.1 time: 0.534534 Aug 30 00:00:14.195558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 490/996] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:13 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1274 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:14.203308 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 507/997] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:13 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:15.213722 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0fbf3edf-6804-413a-99c1-319a0ac3282b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:15.214939 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0fbf3edf-6804-413a-99c1-319a0ac3282b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:15.217897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-61fc0345-bbe6-4231-8f11-bdbf2abff567 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:15.219296 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-61fc0345-bbe6-4231-8f11-bdbf2abff567 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:15.227250 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61fc0345-bbe6-4231-8f11-bdbf2abff567 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:15.227884 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61fc0345-bbe6-4231-8f11-bdbf2abff567 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:15.229325 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0fbf3edf-6804-413a-99c1-319a0ac3282b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:15.229721 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61fc0345-bbe6-4231-8f11-bdbf2abff567 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:15.230172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0fbf3edf-6804-413a-99c1-319a0ac3282b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:15.231243 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0fbf3edf-6804-413a-99c1-319a0ac3282b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:15.232704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0fbf3edf-6804-413a-99c1-319a0ac3282b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:15.233058 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61fc0345-bbe6-4231-8f11-bdbf2abff567 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:15.233791 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0fbf3edf-6804-413a-99c1-319a0ac3282b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:15.233997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61fc0345-bbe6-4231-8f11-bdbf2abff567 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:15.234641 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0fbf3edf-6804-413a-99c1-319a0ac3282b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:15.235371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-61fc0345-bbe6-4231-8f11-bdbf2abff567 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:15.468845 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0fbf3edf-6804-413a-99c1-319a0ac3282b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:15.507920 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0fbf3edf-6804-413a-99c1-319a0ac3282b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1279 microversion: 2.1 time: 0.301012 Aug 30 00:00:15.512959 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 508/998] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:15 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1279 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:15.597250 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-61fc0345-bbe6-4231-8f11-bdbf2abff567 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:15.605445 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-61fc0345-bbe6-4231-8f11-bdbf2abff567 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1314 microversion: 2.1 time: 0.392724 Aug 30 00:00:15.608552 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 491/999] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:15 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:16.431056 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-f311204a-e173-473f-9afb-1caba006feb6 req-10c74d08-f222-4b02-9fe7-7d96780ca1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f0485b-1ac6-49db-a957-9bb8ae5ad666", "tag": "e2b19f8e-5e64-4eec-9e27-d8fb601f7a87"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:16.443902 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-f311204a-e173-473f-9afb-1caba006feb6 req-10c74d08-f222-4b02-9fe7-7d96780ca1ca service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.450122 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-f311204a-e173-473f-9afb-1caba006feb6 req-10c74d08-f222-4b02-9fe7-7d96780ca1ca service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.450122 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-f311204a-e173-473f-9afb-1caba006feb6 req-10c74d08-f222-4b02-9fe7-7d96780ca1ca service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.458169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-f311204a-e173-473f-9afb-1caba006feb6 req-10c74d08-f222-4b02-9fe7-7d96780ca1ca service nova] Creating event network-changed:e2b19f8e-5e64-4eec-9e27-d8fb601f7a87 for instance 62f0485b-1ac6-49db-a957-9bb8ae5ad666 on hv-cinder-85427 Aug 30 00:00:16.464347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-f311204a-e173-473f-9afb-1caba006feb6 req-10c74d08-f222-4b02-9fe7-7d96780ca1ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037444 Aug 30 00:00:16.466719 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 509/1000] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:16.539915 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-413b06ab-6ea3-408b-a5d3-c772f8b931ac tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:16.541277 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-413b06ab-6ea3-408b-a5d3-c772f8b931ac tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:16.551493 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-413b06ab-6ea3-408b-a5d3-c772f8b931ac tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.552049 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-413b06ab-6ea3-408b-a5d3-c772f8b931ac tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.552497 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-413b06ab-6ea3-408b-a5d3-c772f8b931ac tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.553222 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-413b06ab-6ea3-408b-a5d3-c772f8b931ac tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.558358 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-413b06ab-6ea3-408b-a5d3-c772f8b931ac tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.558358 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-413b06ab-6ea3-408b-a5d3-c772f8b931ac tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.635180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-67ddae48-0dc6-4794-bec3-62760e76d7bd tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:16.636427 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-67ddae48-0dc6-4794-bec3-62760e76d7bd tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:16.646128 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ddae48-0dc6-4794-bec3-62760e76d7bd tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.646679 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ddae48-0dc6-4794-bec3-62760e76d7bd tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.647356 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ddae48-0dc6-4794-bec3-62760e76d7bd tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.648435 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ddae48-0dc6-4794-bec3-62760e76d7bd tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:16.649666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ddae48-0dc6-4794-bec3-62760e76d7bd tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:16.650281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-67ddae48-0dc6-4794-bec3-62760e76d7bd tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:16.892998 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-413b06ab-6ea3-408b-a5d3-c772f8b931ac tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:16.898949 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-413b06ab-6ea3-408b-a5d3-c772f8b931ac tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1319 microversion: 2.1 time: 0.365520 Aug 30 00:00:16.899636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 492/1001] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:16 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:16.917824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-67ddae48-0dc6-4794-bec3-62760e76d7bd tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:16.927300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-67ddae48-0dc6-4794-bec3-62760e76d7bd tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1314 microversion: 2.1 time: 0.296245 Aug 30 00:00:16.927300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 510/1002] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:16 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:17.342134 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-bad0daf7-6450-4ff6-939b-9b60855a6ffb req-324e1cca-34bc-419a-9c6a-bb6c132d548d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc", "tag": "6457177b-6221-40a0-b29b-318a9bcc2742"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:17.352833 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-bad0daf7-6450-4ff6-939b-9b60855a6ffb req-324e1cca-34bc-419a-9c6a-bb6c132d548d service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.353669 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-bad0daf7-6450-4ff6-939b-9b60855a6ffb req-324e1cca-34bc-419a-9c6a-bb6c132d548d service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.354948 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-bad0daf7-6450-4ff6-939b-9b60855a6ffb req-324e1cca-34bc-419a-9c6a-bb6c132d548d service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.368175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-bad0daf7-6450-4ff6-939b-9b60855a6ffb req-324e1cca-34bc-419a-9c6a-bb6c132d548d service nova] Creating event network-changed:6457177b-6221-40a0-b29b-318a9bcc2742 for instance 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc on hv-cinder-85427 Aug 30 00:00:17.375497 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-bad0daf7-6450-4ff6-939b-9b60855a6ffb req-324e1cca-34bc-419a-9c6a-bb6c132d548d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038861 Aug 30 00:00:17.376524 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 493/1003] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:17.922283 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-edfd1ac7-baea-48f3-9eb5-82239aa0e685 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:17.923014 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-edfd1ac7-baea-48f3-9eb5-82239aa0e685 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:17.933142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edfd1ac7-baea-48f3-9eb5-82239aa0e685 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.934159 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edfd1ac7-baea-48f3-9eb5-82239aa0e685 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.934704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edfd1ac7-baea-48f3-9eb5-82239aa0e685 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.935761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edfd1ac7-baea-48f3-9eb5-82239aa0e685 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.936209 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edfd1ac7-baea-48f3-9eb5-82239aa0e685 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.936796 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-edfd1ac7-baea-48f3-9eb5-82239aa0e685 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.962654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2a00d598-b5c7-430b-b319-4b30f64ffdb5 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:17.963566 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2a00d598-b5c7-430b-b319-4b30f64ffdb5 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:17.974377 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a00d598-b5c7-430b-b319-4b30f64ffdb5 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.974924 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a00d598-b5c7-430b-b319-4b30f64ffdb5 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.975614 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a00d598-b5c7-430b-b319-4b30f64ffdb5 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:17.976618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a00d598-b5c7-430b-b319-4b30f64ffdb5 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:17.976618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a00d598-b5c7-430b-b319-4b30f64ffdb5 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:17.976889 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a00d598-b5c7-430b-b319-4b30f64ffdb5 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:18.190655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-edfd1ac7-baea-48f3-9eb5-82239aa0e685 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:18.194313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2a00d598-b5c7-430b-b319-4b30f64ffdb5 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:18.202279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-edfd1ac7-baea-48f3-9eb5-82239aa0e685 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1319 microversion: 2.1 time: 0.284956 Aug 30 00:00:18.203144 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 511/1004] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:17 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:18.209528 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2a00d598-b5c7-430b-b319-4b30f64ffdb5 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1314 microversion: 2.1 time: 0.252605 Aug 30 00:00:18.222150 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 494/1005] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:17 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:19.224703 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-71336742-5f22-4e67-868c-2f012c2aaf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:19.225325 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-71336742-5f22-4e67-868c-2f012c2aaf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:19.232635 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-71336742-5f22-4e67-868c-2f012c2aaf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:19.232953 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-14f14a21-a828-4bb9-9c79-a0c9aca2b834 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:19.233453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-71336742-5f22-4e67-868c-2f012c2aaf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:19.233583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-71336742-5f22-4e67-868c-2f012c2aaf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.234249 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-71336742-5f22-4e67-868c-2f012c2aaf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:19.234667 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-14f14a21-a828-4bb9-9c79-a0c9aca2b834 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:19.234786 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-71336742-5f22-4e67-868c-2f012c2aaf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:19.254655 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-71336742-5f22-4e67-868c-2f012c2aaf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.254849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14f14a21-a828-4bb9-9c79-a0c9aca2b834 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:19.254849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14f14a21-a828-4bb9-9c79-a0c9aca2b834 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:19.254849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14f14a21-a828-4bb9-9c79-a0c9aca2b834 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.254849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14f14a21-a828-4bb9-9c79-a0c9aca2b834 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:19.255213 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14f14a21-a828-4bb9-9c79-a0c9aca2b834 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:19.255213 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-14f14a21-a828-4bb9-9c79-a0c9aca2b834 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:19.465831 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-71336742-5f22-4e67-868c-2f012c2aaf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:19.475191 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-71336742-5f22-4e67-868c-2f012c2aaf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1319 microversion: 2.1 time: 0.254606 Aug 30 00:00:19.481905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 512/1006] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:19 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:19.501706 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-14f14a21-a828-4bb9-9c79-a0c9aca2b834 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:19.515518 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-14f14a21-a828-4bb9-9c79-a0c9aca2b834 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1314 microversion: 2.1 time: 0.286995 Aug 30 00:00:19.516245 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 495/1007] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:19 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:20.498982 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-339ed201-df29-4cc1-8355-4d8e11c33839 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:20.499600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-339ed201-df29-4cc1-8355-4d8e11c33839 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:20.507120 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-339ed201-df29-4cc1-8355-4d8e11c33839 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:20.507619 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-339ed201-df29-4cc1-8355-4d8e11c33839 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:20.508056 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-339ed201-df29-4cc1-8355-4d8e11c33839 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:20.508770 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-339ed201-df29-4cc1-8355-4d8e11c33839 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:20.509228 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-339ed201-df29-4cc1-8355-4d8e11c33839 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:20.509657 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-339ed201-df29-4cc1-8355-4d8e11c33839 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:20.543776 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-871f405d-d0ea-4906-b8d1-9aa0d6244c16 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:20.547269 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-871f405d-d0ea-4906-b8d1-9aa0d6244c16 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:20.554616 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-871f405d-d0ea-4906-b8d1-9aa0d6244c16 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:20.555104 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-871f405d-d0ea-4906-b8d1-9aa0d6244c16 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:20.555542 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-871f405d-d0ea-4906-b8d1-9aa0d6244c16 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:20.556531 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-871f405d-d0ea-4906-b8d1-9aa0d6244c16 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:20.556714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-871f405d-d0ea-4906-b8d1-9aa0d6244c16 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:20.557288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-871f405d-d0ea-4906-b8d1-9aa0d6244c16 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:20.811927 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-339ed201-df29-4cc1-8355-4d8e11c33839 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:20.815385 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-871f405d-d0ea-4906-b8d1-9aa0d6244c16 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:20.827311 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-871f405d-d0ea-4906-b8d1-9aa0d6244c16 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1314 microversion: 2.1 time: 0.288312 Aug 30 00:00:20.827912 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 496/1008] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:20 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:20.846555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-339ed201-df29-4cc1-8355-4d8e11c33839 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1319 microversion: 2.1 time: 0.351693 Aug 30 00:00:20.847151 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 513/1009] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:20 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:21.072380 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-f911f30c-1d0c-44e5-a26f-309e2aa2f5a3 req-94161fb6-ac64-46d3-99bb-cb2d8f975ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f0485b-1ac6-49db-a957-9bb8ae5ad666", "name": "network-vif-plugged", "status": "completed", "tag": "e2b19f8e-5e64-4eec-9e27-d8fb601f7a87"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:21.084680 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-f911f30c-1d0c-44e5-a26f-309e2aa2f5a3 req-94161fb6-ac64-46d3-99bb-cb2d8f975ab9 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.085149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-f911f30c-1d0c-44e5-a26f-309e2aa2f5a3 req-94161fb6-ac64-46d3-99bb-cb2d8f975ab9 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.085802 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-f911f30c-1d0c-44e5-a26f-309e2aa2f5a3 req-94161fb6-ac64-46d3-99bb-cb2d8f975ab9 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.101393 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-f911f30c-1d0c-44e5-a26f-309e2aa2f5a3 req-94161fb6-ac64-46d3-99bb-cb2d8f975ab9 service nova] Creating event network-vif-plugged:e2b19f8e-5e64-4eec-9e27-d8fb601f7a87 for instance 62f0485b-1ac6-49db-a957-9bb8ae5ad666 on hv-cinder-85427 Aug 30 00:00:21.108025 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-f911f30c-1d0c-44e5-a26f-309e2aa2f5a3 req-94161fb6-ac64-46d3-99bb-cb2d8f975ab9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039005 Aug 30 00:00:21.108968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 497/1010] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:21.858894 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-50542553-e06c-44de-8d74-12728df0c25b tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:21.859621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-50542553-e06c-44de-8d74-12728df0c25b tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:21.866891 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-50542553-e06c-44de-8d74-12728df0c25b tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.867415 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-50542553-e06c-44de-8d74-12728df0c25b tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.867858 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-50542553-e06c-44de-8d74-12728df0c25b tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.868645 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-50542553-e06c-44de-8d74-12728df0c25b tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.869123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-50542553-e06c-44de-8d74-12728df0c25b tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.869574 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-50542553-e06c-44de-8d74-12728df0c25b tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.880406 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-79cd275f-a8e2-4105-a728-cb31454d7955 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:21.881515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-79cd275f-a8e2-4105-a728-cb31454d7955 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:21.891885 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=4 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:21.893158 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=12 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:21.895374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-79cd275f-a8e2-4105-a728-cb31454d7955 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.896015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-79cd275f-a8e2-4105-a728-cb31454d7955 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.896481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-79cd275f-a8e2-4105-a728-cb31454d7955 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:21.897147 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-79cd275f-a8e2-4105-a728-cb31454d7955 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:21.898043 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-79cd275f-a8e2-4105-a728-cb31454d7955 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:21.898477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-79cd275f-a8e2-4105-a728-cb31454d7955 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:22.083107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-50542553-e06c-44de-8d74-12728df0c25b tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:22.095085 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-50542553-e06c-44de-8d74-12728df0c25b tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1314 microversion: 2.1 time: 0.241293 Aug 30 00:00:22.097296 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 514/1011] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:21 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:22.117257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-79cd275f-a8e2-4105-a728-cb31454d7955 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:22.125823 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-79cd275f-a8e2-4105-a728-cb31454d7955 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1319 microversion: 2.1 time: 0.251864 Aug 30 00:00:22.126494 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 498/1012] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:21 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:23.117398 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-474ec585-b544-4b93-8455-bbefdf4e846d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:23.118045 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-474ec585-b544-4b93-8455-bbefdf4e846d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:23.120770 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=8 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:23.124227 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-e85d8862-61f3-4199-98e8-552a31f54f30 req-9103e268-9d0c-44ea-b6e3-95cf4687ede6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc", "name": "network-vif-plugged", "status": "completed", "tag": "6457177b-6221-40a0-b29b-318a9bcc2742"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:23.135230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-e85d8862-61f3-4199-98e8-552a31f54f30 req-9103e268-9d0c-44ea-b6e3-95cf4687ede6 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.135615 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-e85d8862-61f3-4199-98e8-552a31f54f30 req-9103e268-9d0c-44ea-b6e3-95cf4687ede6 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.136229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-e85d8862-61f3-4199-98e8-552a31f54f30 req-9103e268-9d0c-44ea-b6e3-95cf4687ede6 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.137559 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-474ec585-b544-4b93-8455-bbefdf4e846d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.138210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-474ec585-b544-4b93-8455-bbefdf4e846d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.138677 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-474ec585-b544-4b93-8455-bbefdf4e846d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.139386 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-474ec585-b544-4b93-8455-bbefdf4e846d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.139829 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-474ec585-b544-4b93-8455-bbefdf4e846d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.145742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-474ec585-b544-4b93-8455-bbefdf4e846d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.151459 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-e85d8862-61f3-4199-98e8-552a31f54f30 req-9103e268-9d0c-44ea-b6e3-95cf4687ede6 service nova] Creating event network-vif-plugged:6457177b-6221-40a0-b29b-318a9bcc2742 for instance 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc on hv-cinder-85427 Aug 30 00:00:23.156089 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-e85d8862-61f3-4199-98e8-552a31f54f30 req-9103e268-9d0c-44ea-b6e3-95cf4687ede6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034879 Aug 30 00:00:23.156785 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 499/1013] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:23.162034 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-71e20907-c839-4e5c-b137-e2675460e989 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:23.162969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-71e20907-c839-4e5c-b137-e2675460e989 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:23.172824 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-71e20907-c839-4e5c-b137-e2675460e989 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.173661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-71e20907-c839-4e5c-b137-e2675460e989 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.174667 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-71e20907-c839-4e5c-b137-e2675460e989 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.175848 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-71e20907-c839-4e5c-b137-e2675460e989 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:23.176463 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-71e20907-c839-4e5c-b137-e2675460e989 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:23.177214 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-71e20907-c839-4e5c-b137-e2675460e989 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:23.432790 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-474ec585-b544-4b93-8455-bbefdf4e846d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:23.442451 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-474ec585-b544-4b93-8455-bbefdf4e846d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1314 microversion: 2.1 time: 0.328966 Aug 30 00:00:23.455008 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 515/1014] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:23 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:23.479436 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-71e20907-c839-4e5c-b137-e2675460e989 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:23.487780 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-71e20907-c839-4e5c-b137-e2675460e989 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1319 microversion: 2.1 time: 0.329820 Aug 30 00:00:23.488353 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 500/1015] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:23 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:24.464967 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9857e949-7c04-46cc-a260-181c70818f2d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:24.465759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9857e949-7c04-46cc-a260-181c70818f2d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:24.473643 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9857e949-7c04-46cc-a260-181c70818f2d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.474407 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9857e949-7c04-46cc-a260-181c70818f2d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.475007 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9857e949-7c04-46cc-a260-181c70818f2d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.475726 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9857e949-7c04-46cc-a260-181c70818f2d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.476183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9857e949-7c04-46cc-a260-181c70818f2d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.476720 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9857e949-7c04-46cc-a260-181c70818f2d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.510440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fa2e08a2-b42d-4da8-9053-3a787465ebfd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:24.511118 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-fa2e08a2-b42d-4da8-9053-3a787465ebfd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:24.520781 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa2e08a2-b42d-4da8-9053-3a787465ebfd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.520781 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa2e08a2-b42d-4da8-9053-3a787465ebfd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.521140 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa2e08a2-b42d-4da8-9053-3a787465ebfd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.521881 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa2e08a2-b42d-4da8-9053-3a787465ebfd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.522335 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa2e08a2-b42d-4da8-9053-3a787465ebfd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.526622 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fa2e08a2-b42d-4da8-9053-3a787465ebfd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.682892 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9857e949-7c04-46cc-a260-181c70818f2d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:24.696361 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9857e949-7c04-46cc-a260-181c70818f2d tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1463 microversion: 2.1 time: 0.235050 Aug 30 00:00:24.697439 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 516/1016] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:24 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1463 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:24.736776 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-fa2e08a2-b42d-4da8-9053-3a787465ebfd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:24.744254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-81f0a554-fbad-4fa2-86fe-edcc686e1a99 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:24.749786 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-81f0a554-fbad-4fa2-86fe-edcc686e1a99 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:24.749938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-fa2e08a2-b42d-4da8-9053-3a787465ebfd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1319 microversion: 2.1 time: 0.240737 Aug 30 00:00:24.749938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 501/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:24 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:00:24.752273 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-81f0a554-fbad-4fa2-86fe-edcc686e1a99 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.752838 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-81f0a554-fbad-4fa2-86fe-edcc686e1a99 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.753341 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-81f0a554-fbad-4fa2-86fe-edcc686e1a99 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.754113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-81f0a554-fbad-4fa2-86fe-edcc686e1a99 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:24.754687 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-81f0a554-fbad-4fa2-86fe-edcc686e1a99 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:24.755181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-81f0a554-fbad-4fa2-86fe-edcc686e1a99 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:24.781924 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-81f0a554-fbad-4fa2-86fe-edcc686e1a99 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:00:25.189253 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-81f0a554-fbad-4fa2-86fe-edcc686e1a99 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "DELETE /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 204 len: 0 microversion: 2.1 time: 0.447912 Aug 30 00:00:25.190139 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 517/1018] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 30 00:00:24 2022] DELETE /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 00:00:25.198883 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-ed4aacb3-83d5-4371-b495-a277971d0922 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:25.199709 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-ed4aacb3-83d5-4371-b495-a277971d0922 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:25.207205 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ed4aacb3-83d5-4371-b495-a277971d0922 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.207693 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ed4aacb3-83d5-4371-b495-a277971d0922 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.208118 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ed4aacb3-83d5-4371-b495-a277971d0922 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.208824 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ed4aacb3-83d5-4371-b495-a277971d0922 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.209480 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ed4aacb3-83d5-4371-b495-a277971d0922 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.209897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-ed4aacb3-83d5-4371-b495-a277971d0922 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.396189 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-ed4aacb3-83d5-4371-b495-a277971d0922 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:25.405148 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-ed4aacb3-83d5-4371-b495-a277971d0922 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1469 microversion: 2.1 time: 0.210530 Aug 30 00:00:25.405744 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 502/1019] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:25 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:25.769224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2009fc4a-aaf7-4713-8a91-5771780ba6f3 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:25.769928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2009fc4a-aaf7-4713-8a91-5771780ba6f3 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:25.777364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2009fc4a-aaf7-4713-8a91-5771780ba6f3 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.778376 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2009fc4a-aaf7-4713-8a91-5771780ba6f3 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.778906 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2009fc4a-aaf7-4713-8a91-5771780ba6f3 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.779629 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2009fc4a-aaf7-4713-8a91-5771780ba6f3 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:25.780099 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2009fc4a-aaf7-4713-8a91-5771780ba6f3 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:25.780519 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2009fc4a-aaf7-4713-8a91-5771780ba6f3 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:25.957809 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2009fc4a-aaf7-4713-8a91-5771780ba6f3 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:25.967220 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2009fc4a-aaf7-4713-8a91-5771780ba6f3 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1509 microversion: 2.1 time: 0.202528 Aug 30 00:00:25.967804 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 518/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:25 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:26.428391 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5c5fac23-8d92-4606-81bd-bf4807183b09 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:26.429301 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5c5fac23-8d92-4606-81bd-bf4807183b09 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:26.437643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5c5fac23-8d92-4606-81bd-bf4807183b09 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:26.438130 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5c5fac23-8d92-4606-81bd-bf4807183b09 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:26.438609 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5c5fac23-8d92-4606-81bd-bf4807183b09 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:26.439330 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5c5fac23-8d92-4606-81bd-bf4807183b09 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:26.440034 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5c5fac23-8d92-4606-81bd-bf4807183b09 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:26.440471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5c5fac23-8d92-4606-81bd-bf4807183b09 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:26.627396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5c5fac23-8d92-4606-81bd-bf4807183b09 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:26.638910 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5c5fac23-8d92-4606-81bd-bf4807183b09 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1469 microversion: 2.1 time: 0.215029 Aug 30 00:00:26.639694 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 503/1021] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:26 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1469 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:27.483143 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-50643b0b-f1c6-404f-941a-23c26889bb8c req-a198ad2d-d241-4afc-8ae6-d03b59a1da26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f0485b-1ac6-49db-a957-9bb8ae5ad666", "name": "network-vif-deleted", "tag": "e2b19f8e-5e64-4eec-9e27-d8fb601f7a87"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:27.495635 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-50643b0b-f1c6-404f-941a-23c26889bb8c req-a198ad2d-d241-4afc-8ae6-d03b59a1da26 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.496138 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-50643b0b-f1c6-404f-941a-23c26889bb8c req-a198ad2d-d241-4afc-8ae6-d03b59a1da26 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.496766 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-50643b0b-f1c6-404f-941a-23c26889bb8c req-a198ad2d-d241-4afc-8ae6-d03b59a1da26 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:27.511085 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-50643b0b-f1c6-404f-941a-23c26889bb8c req-a198ad2d-d241-4afc-8ae6-d03b59a1da26 service nova] Creating event network-vif-deleted:e2b19f8e-5e64-4eec-9e27-d8fb601f7a87 for instance 62f0485b-1ac6-49db-a957-9bb8ae5ad666 on hv-cinder-85427 Aug 30 00:00:27.520700 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-50643b0b-f1c6-404f-941a-23c26889bb8c req-a198ad2d-d241-4afc-8ae6-d03b59a1da26 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047063 Aug 30 00:00:27.522114 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 519/1022] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:00:27.661504 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5dee1439-a42e-4c13-a133-a9f450928c29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:27.662137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5dee1439-a42e-4c13-a133-a9f450928c29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:27.669195 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dee1439-a42e-4c13-a133-a9f450928c29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.669669 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dee1439-a42e-4c13-a133-a9f450928c29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.670105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dee1439-a42e-4c13-a133-a9f450928c29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:27.673065 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dee1439-a42e-4c13-a133-a9f450928c29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:27.673065 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dee1439-a42e-4c13-a133-a9f450928c29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:27.673065 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5dee1439-a42e-4c13-a133-a9f450928c29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:27.754053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5dee1439-a42e-4c13-a133-a9f450928c29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:27.769271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5dee1439-a42e-4c13-a133-a9f450928c29 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1299 microversion: 2.1 time: 0.112682 Aug 30 00:00:27.769875 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 504/1023] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:27 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:28.801702 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:28.803060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:28.811625 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:28.812105 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:28.818686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:28.818686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:28.818686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:28.818686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:28.870485 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:28.870989 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:28.872101 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:28.872559 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lazy-loading 'fault' on Instance uuid 62f0485b-1ac6-49db-a957-9bb8ae5ad666 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:00:28.944012 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42a2a81700ff44c394602c9a5fac5df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6be07438a47fb9b13974bd61fbe57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:00:28.944012 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-88f1cad4-9627-43ba-8527-8fc384bdacc9 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 200 len: 1304 microversion: 2.1 time: 0.134008 Aug 30 00:00:28.944012 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 520/1024] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:28 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:00:29.957120 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:00:29.957804 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] [instance: 62f0485b-1ac6-49db-a957-9bb8ae5ad666] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:29.964298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:29.964786 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:29.965363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:29.966240 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:29.966729 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:29.967162 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:29.984594 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] HTTP exception thrown: Instance 62f0485b-1ac6-49db-a957-9bb8ae5ad666 could not be found. Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Request method failure captured: Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 HTTP/1.1 Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVMH4kH4Fdy2dtnOH74azLu5CmhGftskTPloMaFDlbFLwxJw800Wena-rEgZhhDUd2WpllATRNqAsV27vq0I8bTT1Dh8jxJw-0W63THkqGOVVxXV02NF1Tuj_DFc09woFw8k95QUQs8SyuKOYjt1Sa4oveXvAAY9YI2yid5dF8XVEOc Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: afc6be07438a47fb9b13974bd61fbe57 Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-VolumesNegativeTest-831393238 Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 30 00:00:29.986298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/afc6be07438a47fb9b13974bd61fbe57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/afc6be07438a47fb9b13974bd61fbe57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/afc6be07438a47fb9b13974bd61fbe57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_afc6be07438a47fb9b13974bd61fbe57", "adminURL": "http://10.222.0.58:8080"}]}] Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-VolumesNegativeTest-831393238 Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: afc6be07438a47fb9b13974bd61fbe57 Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-VolumesNegativeTest-831393238 Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-VolumesNegativeTest-831393238-project Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 42a2a81700ff44c394602c9a5fac5df0 Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-VolumesNegativeTest-831393238-project Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 62f0485b-1ac6-49db-a957-9bb8ae5ad666 could not be found. Aug 30 00:00:29.988806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '62f0485b-1ac6-49db-a957-9bb8ae5ad666'} Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f0485b-1ac6-49db-a957-9bb8ae5ad666 could not be found. Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:00:29.990284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f0485b-1ac6-49db-a957-9bb8ae5ad666 could not be found. Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f0485b-1ac6-49db-a957-9bb8ae5ad666 could not be found. Aug 30 00:00:29.993029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:00:29.995800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] Returning 404 to user: Instance 62f0485b-1ac6-49db-a957-9bb8ae5ad666 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:00:29.995800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5d3a5c14-b2c0-4946-97ac-443213119bb2 tempest-VolumesNegativeTest-831393238 tempest-VolumesNegativeTest-831393238-project] 10.222.0.58 "GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666" status: 404 len: 111 microversion: 2.1 time: 0.035043 Aug 30 00:00:29.995800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 505/1025] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:00:29 2022] GET /compute/v2.1/servers/62f0485b-1ac6-49db-a957-9bb8ae5ad666 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:00:43.966859 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-334963e0-b5a4-4b9b-be5a-efe4bda10347 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "657c0b98-d6c4-4026-81ad-2ef8252b7b42", "device": "/dev/sdb"}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:00:43.969689 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-334963e0-b5a4-4b9b-be5a-efe4bda10347 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:00:43.971954 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:43.972686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:00:43.977759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-334963e0-b5a4-4b9b-be5a-efe4bda10347 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:43.978246 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-334963e0-b5a4-4b9b-be5a-efe4bda10347 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:43.978711 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-334963e0-b5a4-4b9b-be5a-efe4bda10347 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:43.979402 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-334963e0-b5a4-4b9b-be5a-efe4bda10347 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:00:43.979848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-334963e0-b5a4-4b9b-be5a-efe4bda10347 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:00:43.980266 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-334963e0-b5a4-4b9b-be5a-efe4bda10347 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:00:44.998128 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-334963e0-b5a4-4b9b-be5a-efe4bda10347 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "POST /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.035144 Aug 30 00:00:44.998830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 521/1026] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 30 00:00:43 2022] POST /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:02.171225 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-53c4e316-e6c5-4807-a4cf-11012e4b1ea3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:02.171874 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-53c4e316-e6c5-4807-a4cf-11012e4b1ea3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:02.175210 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:02.176151 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=90 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:02.182110 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53c4e316-e6c5-4807-a4cf-11012e4b1ea3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:02.185501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53c4e316-e6c5-4807-a4cf-11012e4b1ea3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:02.185501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53c4e316-e6c5-4807-a4cf-11012e4b1ea3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:02.185501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53c4e316-e6c5-4807-a4cf-11012e4b1ea3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:02.185501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53c4e316-e6c5-4807-a4cf-11012e4b1ea3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:02.186071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-53c4e316-e6c5-4807-a4cf-11012e4b1ea3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:02.218864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-53c4e316-e6c5-4807-a4cf-11012e4b1ea3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Going to try to terminate instance {{(pid=127706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:01:02.633713 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-53c4e316-e6c5-4807-a4cf-11012e4b1ea3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 204 len: 0 microversion: 2.1 time: 0.467942 Aug 30 00:01:02.634397 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 506/1027] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 30 00:01:02 2022] DELETE /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:02.643369 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-cd65e072-8d29-4329-8259-26ea1ec0a9c1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:02.649824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-cd65e072-8d29-4329-8259-26ea1ec0a9c1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:02.649824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:02.649824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:02.652441 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd65e072-8d29-4329-8259-26ea1ec0a9c1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:02.653055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd65e072-8d29-4329-8259-26ea1ec0a9c1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:02.653497 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd65e072-8d29-4329-8259-26ea1ec0a9c1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:02.654201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd65e072-8d29-4329-8259-26ea1ec0a9c1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:02.654695 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd65e072-8d29-4329-8259-26ea1ec0a9c1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:02.655122 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-cd65e072-8d29-4329-8259-26ea1ec0a9c1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:02.827971 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-cd65e072-8d29-4329-8259-26ea1ec0a9c1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:02.836213 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-cd65e072-8d29-4329-8259-26ea1ec0a9c1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1578 microversion: 2.1 time: 0.197112 Aug 30 00:01:02.836807 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 522/1028] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:02 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1578 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:03.859677 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b73d2230-1d0f-4b23-a740-10217e836744 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:03.861178 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b73d2230-1d0f-4b23-a740-10217e836744 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:03.867700 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b73d2230-1d0f-4b23-a740-10217e836744 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:03.868173 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b73d2230-1d0f-4b23-a740-10217e836744 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:03.868603 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b73d2230-1d0f-4b23-a740-10217e836744 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:03.869284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b73d2230-1d0f-4b23-a740-10217e836744 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:03.869724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b73d2230-1d0f-4b23-a740-10217e836744 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:03.870137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b73d2230-1d0f-4b23-a740-10217e836744 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:04.010934 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b73d2230-1d0f-4b23-a740-10217e836744 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:04.019355 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b73d2230-1d0f-4b23-a740-10217e836744 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1578 microversion: 2.1 time: 0.163852 Aug 30 00:01:04.019933 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 507/1029] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:03 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:05.041180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d5c59f83-5c4a-4538-90a6-0f4d9693a243 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:05.041757 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d5c59f83-5c4a-4538-90a6-0f4d9693a243 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:05.048581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c59f83-5c4a-4538-90a6-0f4d9693a243 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:05.049064 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c59f83-5c4a-4538-90a6-0f4d9693a243 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:05.049557 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c59f83-5c4a-4538-90a6-0f4d9693a243 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:05.050251 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c59f83-5c4a-4538-90a6-0f4d9693a243 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:05.050756 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c59f83-5c4a-4538-90a6-0f4d9693a243 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:05.051178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d5c59f83-5c4a-4538-90a6-0f4d9693a243 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:05.364941 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d5c59f83-5c4a-4538-90a6-0f4d9693a243 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:05.372717 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d5c59f83-5c4a-4538-90a6-0f4d9693a243 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1578 microversion: 2.1 time: 0.335931 Aug 30 00:01:05.373375 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 523/1030] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:05 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1578 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:06.394713 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-a576fc01-4a39-4b82-bb5c-c7460ee79621 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:06.395313 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-a576fc01-4a39-4b82-bb5c-c7460ee79621 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:06.402006 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a576fc01-4a39-4b82-bb5c-c7460ee79621 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:06.410686 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a576fc01-4a39-4b82-bb5c-c7460ee79621 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:06.410686 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a576fc01-4a39-4b82-bb5c-c7460ee79621 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:06.410686 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a576fc01-4a39-4b82-bb5c-c7460ee79621 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:06.410686 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a576fc01-4a39-4b82-bb5c-c7460ee79621 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:06.411138 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-a576fc01-4a39-4b82-bb5c-c7460ee79621 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:06.606868 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-a576fc01-4a39-4b82-bb5c-c7460ee79621 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:06.615993 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-a576fc01-4a39-4b82-bb5c-c7460ee79621 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1578 microversion: 2.1 time: 0.225424 Aug 30 00:01:06.616562 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 508/1031] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:06 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:07.638355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-491e6ee0-4d3a-422c-80ac-814bcd9fa130 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:07.639154 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-491e6ee0-4d3a-422c-80ac-814bcd9fa130 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:07.646713 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-491e6ee0-4d3a-422c-80ac-814bcd9fa130 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:07.647319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-491e6ee0-4d3a-422c-80ac-814bcd9fa130 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:07.647967 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-491e6ee0-4d3a-422c-80ac-814bcd9fa130 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:07.648690 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-491e6ee0-4d3a-422c-80ac-814bcd9fa130 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:07.649169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-491e6ee0-4d3a-422c-80ac-814bcd9fa130 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:07.649605 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-491e6ee0-4d3a-422c-80ac-814bcd9fa130 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:07.757594 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-491e6ee0-4d3a-422c-80ac-814bcd9fa130 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:07.767569 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-491e6ee0-4d3a-422c-80ac-814bcd9fa130 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1510 microversion: 2.1 time: 0.132775 Aug 30 00:01:07.768260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 524/1032] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:07 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1510 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:07.905583 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-a2bc4597-1979-4537-adb3-75caadbee78f req-809cd3ca-c7a8-4ede-a6bd-90e61ce741b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b660d30-8ce5-48f3-9337-2dbcd3c62e05", "name": "network-vif-deleted", "tag": "3a779311-29d6-4a4e-8a36-b80f881603ea"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:07.917333 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-a2bc4597-1979-4537-adb3-75caadbee78f req-809cd3ca-c7a8-4ede-a6bd-90e61ce741b5 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:07.917817 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-a2bc4597-1979-4537-adb3-75caadbee78f req-809cd3ca-c7a8-4ede-a6bd-90e61ce741b5 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:07.918248 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-a2bc4597-1979-4537-adb3-75caadbee78f req-809cd3ca-c7a8-4ede-a6bd-90e61ce741b5 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:07.932392 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-a2bc4597-1979-4537-adb3-75caadbee78f req-809cd3ca-c7a8-4ede-a6bd-90e61ce741b5 service nova] Creating event network-vif-deleted:3a779311-29d6-4a4e-8a36-b80f881603ea for instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 on hv-cinder-85427 Aug 30 00:01:07.937302 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-a2bc4597-1979-4537-adb3-75caadbee78f req-809cd3ca-c7a8-4ede-a6bd-90e61ce741b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035507 Aug 30 00:01:07.941421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 509/1033] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:08.796211 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:08.798299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:08.814653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:08.819053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:08.819053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:08.819053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:08.819053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:08.819831 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:08.869155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:08.869716 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:08.870458 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:08.871432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lazy-loading 'fault' on Instance uuid 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:08.922869 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:08.933708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1c43c9bf-247e-42a7-8ca4-c67833ca027a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 200 len: 1230 microversion: 2.1 time: 0.145866 Aug 30 00:01:08.934684 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 525/1034] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:08 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 1230 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:09.961754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:09.962485 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:09.969109 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:09.969596 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:09.970035 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:09.970827 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:09.971285 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:09.971719 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:09.971825 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2bcb0423-6e0e-4ebb-b247-e1a1e41e4b6b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:09.972280 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2bcb0423-6e0e-4ebb-b247-e1a1e41e4b6b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:09.979164 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2bcb0423-6e0e-4ebb-b247-e1a1e41e4b6b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:09.979657 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2bcb0423-6e0e-4ebb-b247-e1a1e41e4b6b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:09.980071 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2bcb0423-6e0e-4ebb-b247-e1a1e41e4b6b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:09.980763 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2bcb0423-6e0e-4ebb-b247-e1a1e41e4b6b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:09.981205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2bcb0423-6e0e-4ebb-b247-e1a1e41e4b6b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:09.981620 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2bcb0423-6e0e-4ebb-b247-e1a1e41e4b6b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:09.987115 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] HTTP exception thrown: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Request method failure captured: Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 HTTP/1.1 Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVJ_fB-DF2fs89Mj2dTal5ah3NclNk4ZyCxlz79w60JXYS95Tg41WkW-ILRVFW-I3lmf3Q48alB6OVFFmFyBESyeRovylc0yKoFR2laEdBeioH972qu_mS3mMTc-sb-OyDxnYONEe1WKYgIoHkt4fbhM-pXBoYAR5p0-2o2PHLkoLR8 Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: c78ff4cbc0994af8855b1ac67cb281fe Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 30 00:01:09.988917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c78ff4cbc0994af8855b1ac67cb281fe", "adminURL": "http://10.222.0.58:8080"}]}] Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: c78ff4cbc0994af8855b1ac67cb281fe Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-TestVolumeBootPattern-1495322451-project Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 1e63436f5691431d802706a8d5a6df7f Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-TestVolumeBootPattern-1495322451-project Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:01:09.990655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '5b660d30-8ce5-48f3-9337-2dbcd3c62e05'} Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:01:09.991513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:01:09.992806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:01:09.993958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Returning 404 to user: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:01:09.993958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-fdf09194-e734-461b-a137-06ae0957d475 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 404 len: 111 microversion: 2.1 time: 0.033561 Aug 30 00:01:09.993958 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 510/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:09 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:01:10.075450 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-2bcb0423-6e0e-4ebb-b247-e1a1e41e4b6b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lazy-loading 'services' on Instance uuid 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:10.093029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1885166840", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-406797152", "security_groups": [{"name": "tempest-secgroup-smoke-1075183352"}], "block_device_mapping_v2": [{"uuid": "7c4fb718-ff9e-41b0-b390-22688f69045a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b98748d9-f76e-40ff-a76f-dd71e522597e"}]}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:10.217901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] validate_networks() for [('b98748d9-f76e-40ff-a76f-dd71e522597e', None, None, None, None, None)] {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:01:10.404024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2bcb0423-6e0e-4ebb-b247-e1a1e41e4b6b tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "DELETE /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc/os-volume_attachments/657c0b98-d6c4-4026-81ad-2ef8252b7b42" status: 202 len: 0 microversion: 2.1 time: 0.437016 Aug 30 00:01:10.404622 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 526/1036] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 30 00:01:09 2022] DELETE /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc/os-volume_attachments/657c0b98-d6c4-4026-81ad-2ef8252b7b42 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:01:10.634579 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:01:10.635025 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:01:10.635541 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:01:10.635981 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:01:10.636386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:01:10.645802 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:10.646278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:10.646777 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:10.647593 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:10.648051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:10.648501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:10.665946 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Getting quotas for project c78ff4cbc0994af8855b1ac67cb281fe. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:01:10.670161 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Getting quotas for user 1e63436f5691431d802706a8d5a6df7f and project c78ff4cbc0994af8855b1ac67cb281fe. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:01:10.730586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:01:10.732778 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c4fb718-ff9e-41b0-b390-22688f69045a',volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:01:11.187791 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-23aa390e-6982-4d76-ba0a-63a0abfa388f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.091310 Aug 30 00:01:11.187791 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 511/1037] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 30 00:01:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 00:01:11.196209 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f0c2d9cc-a68c-4979-9ce8-cfef1d689c6d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:11.198188 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f0c2d9cc-a68c-4979-9ce8-cfef1d689c6d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:11.270451 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f0c2d9cc-a68c-4979-9ce8-cfef1d689c6d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:11.279432 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f0c2d9cc-a68c-4979-9ce8-cfef1d689c6d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1094 microversion: 2.1 time: 0.089965 Aug 30 00:01:11.280028 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 527/1038] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:11 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:11.542251 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f0094491-d7da-4ca6-aa37-73420786e411 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:11.542763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f0094491-d7da-4ca6-aa37-73420786e411 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:11.549057 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0094491-d7da-4ca6-aa37-73420786e411 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:11.550326 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0094491-d7da-4ca6-aa37-73420786e411 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:11.550655 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0094491-d7da-4ca6-aa37-73420786e411 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:11.551395 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0094491-d7da-4ca6-aa37-73420786e411 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:11.551882 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0094491-d7da-4ca6-aa37-73420786e411 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:11.552399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f0094491-d7da-4ca6-aa37-73420786e411 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:11.581211 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f0094491-d7da-4ca6-aa37-73420786e411 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Going to try to terminate instance {{(pid=127706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:01:11.867466 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f0094491-d7da-4ca6-aa37-73420786e411 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "DELETE /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 204 len: 0 microversion: 2.1 time: 0.329659 Aug 30 00:01:11.868188 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 512/1039] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 30 00:01:11 2022] DELETE /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:11.877073 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-96d666af-724f-4eb5-9794-c7debeedfef7 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:11.879233 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-96d666af-724f-4eb5-9794-c7debeedfef7 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:11.885496 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96d666af-724f-4eb5-9794-c7debeedfef7 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:11.885984 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96d666af-724f-4eb5-9794-c7debeedfef7 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:11.886412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96d666af-724f-4eb5-9794-c7debeedfef7 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:11.887156 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96d666af-724f-4eb5-9794-c7debeedfef7 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:11.887602 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96d666af-724f-4eb5-9794-c7debeedfef7 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:11.888024 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-96d666af-724f-4eb5-9794-c7debeedfef7 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.038650 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-96d666af-724f-4eb5-9794-c7debeedfef7 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:12.047269 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-96d666af-724f-4eb5-9794-c7debeedfef7 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1515 microversion: 2.1 time: 0.174356 Aug 30 00:01:12.047850 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 528/1040] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:11 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:12.301657 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-594e76a3-d396-42c3-baf7-ecd8f1df144e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:12.302343 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-594e76a3-d396-42c3-baf7-ecd8f1df144e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:12.308834 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-594e76a3-d396-42c3-baf7-ecd8f1df144e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:12.309307 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-594e76a3-d396-42c3-baf7-ecd8f1df144e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:12.309730 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-594e76a3-d396-42c3-baf7-ecd8f1df144e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.310501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-594e76a3-d396-42c3-baf7-ecd8f1df144e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:12.310948 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-594e76a3-d396-42c3-baf7-ecd8f1df144e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:12.311364 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-594e76a3-d396-42c3-baf7-ecd8f1df144e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:12.379056 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-594e76a3-d396-42c3-baf7-ecd8f1df144e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:12.387476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-594e76a3-d396-42c3-baf7-ecd8f1df144e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1144 microversion: 2.1 time: 0.090800 Aug 30 00:01:12.388408 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 513/1041] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:12 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:13.075522 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-93263c89-9450-4ba3-8b7d-103f814aa9d1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:13.076172 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-93263c89-9450-4ba3-8b7d-103f814aa9d1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:13.084270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93263c89-9450-4ba3-8b7d-103f814aa9d1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:13.084758 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93263c89-9450-4ba3-8b7d-103f814aa9d1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:13.085192 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93263c89-9450-4ba3-8b7d-103f814aa9d1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:13.085900 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93263c89-9450-4ba3-8b7d-103f814aa9d1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:13.086354 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93263c89-9450-4ba3-8b7d-103f814aa9d1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:13.086807 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-93263c89-9450-4ba3-8b7d-103f814aa9d1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:13.226123 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-93263c89-9450-4ba3-8b7d-103f814aa9d1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:13.238510 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-93263c89-9450-4ba3-8b7d-103f814aa9d1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1515 microversion: 2.1 time: 0.166584 Aug 30 00:01:13.239135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 529/1042] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:13 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:13.422257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-961b437d-6b41-40cb-89e4-90694e1f5f3f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:13.422909 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-961b437d-6b41-40cb-89e4-90694e1f5f3f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:13.429990 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-961b437d-6b41-40cb-89e4-90694e1f5f3f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:13.430502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-961b437d-6b41-40cb-89e4-90694e1f5f3f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:13.430944 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-961b437d-6b41-40cb-89e4-90694e1f5f3f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:13.431709 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-961b437d-6b41-40cb-89e4-90694e1f5f3f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:13.432165 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-961b437d-6b41-40cb-89e4-90694e1f5f3f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:13.432590 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-961b437d-6b41-40cb-89e4-90694e1f5f3f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:13.500153 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-961b437d-6b41-40cb-89e4-90694e1f5f3f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:13.510554 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-961b437d-6b41-40cb-89e4-90694e1f5f3f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1144 microversion: 2.1 time: 0.092219 Aug 30 00:01:13.511278 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 514/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:13 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:14.176287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-97283734-755e-46fc-8a04-34bc811d44d3 req-8ebb3b7b-2349-42b5-91e4-56dffc6f0945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc", "name": "network-vif-deleted", "tag": "6457177b-6221-40a0-b29b-318a9bcc2742"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:14.186357 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-97283734-755e-46fc-8a04-34bc811d44d3 req-8ebb3b7b-2349-42b5-91e4-56dffc6f0945 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.186876 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-97283734-755e-46fc-8a04-34bc811d44d3 req-8ebb3b7b-2349-42b5-91e4-56dffc6f0945 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.187309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-97283734-755e-46fc-8a04-34bc811d44d3 req-8ebb3b7b-2349-42b5-91e4-56dffc6f0945 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.200126 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-97283734-755e-46fc-8a04-34bc811d44d3 req-8ebb3b7b-2349-42b5-91e4-56dffc6f0945 service nova] Creating event network-vif-deleted:6457177b-6221-40a0-b29b-318a9bcc2742 for instance 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc on hv-cinder-85427 Aug 30 00:01:14.205343 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-97283734-755e-46fc-8a04-34bc811d44d3 req-8ebb3b7b-2349-42b5-91e4-56dffc6f0945 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033851 Aug 30 00:01:14.205977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 530/1044] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:14.261062 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7b4a993f-79e5-4138-8725-da521679b987 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:14.261676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7b4a993f-79e5-4138-8725-da521679b987 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:14.267930 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b4a993f-79e5-4138-8725-da521679b987 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.269220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b4a993f-79e5-4138-8725-da521679b987 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.272447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b4a993f-79e5-4138-8725-da521679b987 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.272447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b4a993f-79e5-4138-8725-da521679b987 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.272447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b4a993f-79e5-4138-8725-da521679b987 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.272447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7b4a993f-79e5-4138-8725-da521679b987 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.339571 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7b4a993f-79e5-4138-8725-da521679b987 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:14.352844 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7b4a993f-79e5-4138-8725-da521679b987 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1473 microversion: 2.1 time: 0.096583 Aug 30 00:01:14.353440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 515/1045] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:14 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1473 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:14.534459 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2a7a32a6-2c80-4189-bf71-7f33aae1bc7b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:14.535653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2a7a32a6-2c80-4189-bf71-7f33aae1bc7b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:14.542355 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a7a32a6-2c80-4189-bf71-7f33aae1bc7b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.543886 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a7a32a6-2c80-4189-bf71-7f33aae1bc7b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.543886 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a7a32a6-2c80-4189-bf71-7f33aae1bc7b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.544108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a7a32a6-2c80-4189-bf71-7f33aae1bc7b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:14.544653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a7a32a6-2c80-4189-bf71-7f33aae1bc7b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:14.545163 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2a7a32a6-2c80-4189-bf71-7f33aae1bc7b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:14.622960 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2a7a32a6-2c80-4189-bf71-7f33aae1bc7b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:14.632583 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2a7a32a6-2c80-4189-bf71-7f33aae1bc7b tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1200 microversion: 2.1 time: 0.103859 Aug 30 00:01:14.633443 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 531/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:14 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1200 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:15.374399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:15.375038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:15.383461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:15.383941 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:15.384382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.385135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:15.385577 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:15.385996 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.423990 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:15.425060 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:15.425871 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.426405 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lazy-loading 'fault' on Instance uuid 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:01:15.487878 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:15.496110 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4642c49d-bc81-4317-9666-caf475d623e9 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 200 len: 1309 microversion: 2.1 time: 0.125581 Aug 30 00:01:15.496697 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 516/1047] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:15 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:15.658459 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9ac9600e-d0cb-4837-9ff7-700488a90d76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:15.659640 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9ac9600e-d0cb-4837-9ff7-700488a90d76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:15.667763 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ac9600e-d0cb-4837-9ff7-700488a90d76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:15.668594 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ac9600e-d0cb-4837-9ff7-700488a90d76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:15.669392 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ac9600e-d0cb-4837-9ff7-700488a90d76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.673265 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ac9600e-d0cb-4837-9ff7-700488a90d76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:15.675085 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ac9600e-d0cb-4837-9ff7-700488a90d76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:15.675925 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9ac9600e-d0cb-4837-9ff7-700488a90d76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:15.857703 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9ac9600e-d0cb-4837-9ff7-700488a90d76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:15.868250 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9ac9600e-d0cb-4837-9ff7-700488a90d76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1278 microversion: 2.1 time: 0.215506 Aug 30 00:01:15.870732 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 532/1048] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:15 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:16.519096 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:16.519915 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:16.527041 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.527546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.528054 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.528766 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.529317 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.529751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.548114 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] HTTP exception thrown: Instance 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc could not be found. Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Request method failure captured: Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc HTTP/1.1 Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVMIF4GrR-nPDpOeun4sq0NdAq259DMoS8dy3ADrnd8nWJITN800inquP2Mq9ApfXXlFzYsk59Tox0jOVmDV96kJO6zsIn-lKDqVmGS9ha76eoOky73RW6Pekh1tO2tJoFcwAMdmHgF9Pwv7timcCRDTTaLOpDhg4pHH7IGcdB3WYgk Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 3771a66c80964a40805c3a9f1f51c3da Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-VolumesSnapshotTestJSON-925763777 Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 30 00:01:16.549928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3771a66c80964a40805c3a9f1f51c3da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3771a66c80964a40805c3a9f1f51c3da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3771a66c80964a40805c3a9f1f51c3da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3771a66c80964a40805c3a9f1f51c3da", "adminURL": "http://10.222.0.58:8080"}]}] Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-VolumesSnapshotTestJSON-925763777 Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 3771a66c80964a40805c3a9f1f51c3da Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-925763777 Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-VolumesSnapshotTestJSON-925763777-project Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: bf8fecbb57394e2e8f5dabfd75ac6b7c Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-VolumesSnapshotTestJSON-925763777-project Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc could not be found. Aug 30 00:01:16.553751 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc'} Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc could not be found. Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:01:16.554768 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc could not be found. Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc could not be found. Aug 30 00:01:16.556382 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:01:16.557855 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Returning 404 to user: Instance 757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:01:16.557855 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b5ee5f8e-613c-4697-81d7-eb0e668bb510 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc" status: 404 len: 111 microversion: 2.1 time: 0.036957 Aug 30 00:01:16.557855 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 517/1049] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:16 2022] GET /compute/v2.1/servers/757a61c0-e1fb-47d4-9f72-a4b8ff8fa9bc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:01:16.566615 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-206938de-91d6-44b6-b7df-1448f069f626 req-696e996e-d349-4966-be2e-9e7a9caf5b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f051f8-b22f-462d-9638-085850018918", "tag": "a37b351a-0c4d-40e1-805b-bd45bbb90500"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:16.588397 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-206938de-91d6-44b6-b7df-1448f069f626 req-696e996e-d349-4966-be2e-9e7a9caf5b86 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.589380 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-206938de-91d6-44b6-b7df-1448f069f626 req-696e996e-d349-4966-be2e-9e7a9caf5b86 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.590237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-206938de-91d6-44b6-b7df-1448f069f626 req-696e996e-d349-4966-be2e-9e7a9caf5b86 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.612680 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-206938de-91d6-44b6-b7df-1448f069f626 req-696e996e-d349-4966-be2e-9e7a9caf5b86 service nova] Creating event network-changed:a37b351a-0c4d-40e1-805b-bd45bbb90500 for instance c8f051f8-b22f-462d-9638-085850018918 on hv-cinder-85427 Aug 30 00:01:16.621446 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-206938de-91d6-44b6-b7df-1448f069f626 req-696e996e-d349-4966-be2e-9e7a9caf5b86 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076656 Aug 30 00:01:16.623262 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 533/1050] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:16.889515 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-70af5afc-39aa-48ad-a0f0-706d896cda76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:16.890184 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-70af5afc-39aa-48ad-a0f0-706d896cda76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:16.897229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70af5afc-39aa-48ad-a0f0-706d896cda76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.897718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70af5afc-39aa-48ad-a0f0-706d896cda76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.898155 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70af5afc-39aa-48ad-a0f0-706d896cda76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:16.898897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70af5afc-39aa-48ad-a0f0-706d896cda76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:16.899350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70af5afc-39aa-48ad-a0f0-706d896cda76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:16.899777 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-70af5afc-39aa-48ad-a0f0-706d896cda76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:17.074544 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-70af5afc-39aa-48ad-a0f0-706d896cda76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:17.081184 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-70af5afc-39aa-48ad-a0f0-706d896cda76 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.194878 Aug 30 00:01:17.082502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 518/1051] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:16 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:18.111527 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2d3721a6-bb70-4707-b55a-78f65ad82dc4 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:18.112964 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2d3721a6-bb70-4707-b55a-78f65ad82dc4 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:18.119339 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2d3721a6-bb70-4707-b55a-78f65ad82dc4 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:18.119880 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2d3721a6-bb70-4707-b55a-78f65ad82dc4 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:18.120310 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2d3721a6-bb70-4707-b55a-78f65ad82dc4 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:18.121002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2d3721a6-bb70-4707-b55a-78f65ad82dc4 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:18.121444 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2d3721a6-bb70-4707-b55a-78f65ad82dc4 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:18.121861 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2d3721a6-bb70-4707-b55a-78f65ad82dc4 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:18.286337 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2d3721a6-bb70-4707-b55a-78f65ad82dc4 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:18.294385 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2d3721a6-bb70-4707-b55a-78f65ad82dc4 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.187545 Aug 30 00:01:18.294988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 534/1052] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:18 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:19.316844 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c6383542-8499-4297-b881-b780048bd62e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:19.317401 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c6383542-8499-4297-b881-b780048bd62e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:19.331907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c6383542-8499-4297-b881-b780048bd62e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.333850 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c6383542-8499-4297-b881-b780048bd62e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.334396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c6383542-8499-4297-b881-b780048bd62e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:19.335259 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c6383542-8499-4297-b881-b780048bd62e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:19.336330 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c6383542-8499-4297-b881-b780048bd62e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:19.336754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c6383542-8499-4297-b881-b780048bd62e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:19.481588 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c6383542-8499-4297-b881-b780048bd62e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:19.490131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c6383542-8499-4297-b881-b780048bd62e tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.177607 Aug 30 00:01:19.490758 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 519/1053] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:19 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:20.511286 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a158d4c5-1770-4a36-944a-3cece2f6dab1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:20.511992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a158d4c5-1770-4a36-944a-3cece2f6dab1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:20.518961 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a158d4c5-1770-4a36-944a-3cece2f6dab1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:20.519516 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a158d4c5-1770-4a36-944a-3cece2f6dab1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:20.520231 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a158d4c5-1770-4a36-944a-3cece2f6dab1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.520977 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a158d4c5-1770-4a36-944a-3cece2f6dab1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:20.521479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a158d4c5-1770-4a36-944a-3cece2f6dab1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:20.521973 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a158d4c5-1770-4a36-944a-3cece2f6dab1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:20.656864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a158d4c5-1770-4a36-944a-3cece2f6dab1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:20.670718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a158d4c5-1770-4a36-944a-3cece2f6dab1 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.163210 Aug 30 00:01:20.671320 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 535/1054] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:20 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:21.692916 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f35a8b0b-3d1e-44aa-b464-291ae4b95a26 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:21.693461 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f35a8b0b-3d1e-44aa-b464-291ae4b95a26 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:21.696869 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:21.697136 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=6 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:21.701882 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f35a8b0b-3d1e-44aa-b464-291ae4b95a26 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:21.702352 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f35a8b0b-3d1e-44aa-b464-291ae4b95a26 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:21.702815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f35a8b0b-3d1e-44aa-b464-291ae4b95a26 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:21.703504 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f35a8b0b-3d1e-44aa-b464-291ae4b95a26 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:21.703952 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f35a8b0b-3d1e-44aa-b464-291ae4b95a26 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:21.704372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f35a8b0b-3d1e-44aa-b464-291ae4b95a26 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:21.853346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f35a8b0b-3d1e-44aa-b464-291ae4b95a26 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:21.861546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f35a8b0b-3d1e-44aa-b464-291ae4b95a26 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.172815 Aug 30 00:01:21.867131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 520/1055] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:21 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:22.882839 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3b390dbf-bc0c-4c71-aff5-bd9129fceea8 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:22.883452 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3b390dbf-bc0c-4c71-aff5-bd9129fceea8 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:22.886181 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:22.892452 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3b390dbf-bc0c-4c71-aff5-bd9129fceea8 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.892947 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3b390dbf-bc0c-4c71-aff5-bd9129fceea8 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.893379 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3b390dbf-bc0c-4c71-aff5-bd9129fceea8 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:22.897130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3b390dbf-bc0c-4c71-aff5-bd9129fceea8 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:22.897638 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3b390dbf-bc0c-4c71-aff5-bd9129fceea8 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:22.898146 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3b390dbf-bc0c-4c71-aff5-bd9129fceea8 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:23.044869 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3b390dbf-bc0c-4c71-aff5-bd9129fceea8 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:23.052420 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3b390dbf-bc0c-4c71-aff5-bd9129fceea8 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.173268 Aug 30 00:01:23.053004 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 536/1056] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:22 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:24.074202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f26df9b5-8f11-4087-96a3-1ebc3b9fe3f6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:24.074856 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f26df9b5-8f11-4087-96a3-1ebc3b9fe3f6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:24.081608 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f26df9b5-8f11-4087-96a3-1ebc3b9fe3f6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.082122 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f26df9b5-8f11-4087-96a3-1ebc3b9fe3f6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.082598 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f26df9b5-8f11-4087-96a3-1ebc3b9fe3f6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.083303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f26df9b5-8f11-4087-96a3-1ebc3b9fe3f6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:24.083755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f26df9b5-8f11-4087-96a3-1ebc3b9fe3f6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:24.084175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f26df9b5-8f11-4087-96a3-1ebc3b9fe3f6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:24.103365 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:24.236352 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f26df9b5-8f11-4087-96a3-1ebc3b9fe3f6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:24.248228 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f26df9b5-8f11-4087-96a3-1ebc3b9fe3f6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.178089 Aug 30 00:01:24.248808 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 521/1057] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:24 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:25.270593 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f5ec93f6-8778-4573-bbc1-503ba8856782 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:25.271342 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f5ec93f6-8778-4573-bbc1-503ba8856782 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:25.278006 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5ec93f6-8778-4573-bbc1-503ba8856782 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.278533 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5ec93f6-8778-4573-bbc1-503ba8856782 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.278978 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5ec93f6-8778-4573-bbc1-503ba8856782 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.279681 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5ec93f6-8778-4573-bbc1-503ba8856782 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:25.280124 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5ec93f6-8778-4573-bbc1-503ba8856782 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:25.280537 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5ec93f6-8778-4573-bbc1-503ba8856782 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:25.443439 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f5ec93f6-8778-4573-bbc1-503ba8856782 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:25.454275 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f5ec93f6-8778-4573-bbc1-503ba8856782 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.188718 Aug 30 00:01:25.454911 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 537/1058] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:25 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:26.476861 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4ae815ea-46dd-4aa3-9fdc-ab9f7d7ad89f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:26.477429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4ae815ea-46dd-4aa3-9fdc-ab9f7d7ad89f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:26.483950 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ae815ea-46dd-4aa3-9fdc-ab9f7d7ad89f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:26.484436 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ae815ea-46dd-4aa3-9fdc-ab9f7d7ad89f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:26.484879 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ae815ea-46dd-4aa3-9fdc-ab9f7d7ad89f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.485580 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ae815ea-46dd-4aa3-9fdc-ab9f7d7ad89f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:26.486031 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ae815ea-46dd-4aa3-9fdc-ab9f7d7ad89f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:26.486485 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4ae815ea-46dd-4aa3-9fdc-ab9f7d7ad89f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:26.639112 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-4ae815ea-46dd-4aa3-9fdc-ab9f7d7ad89f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:26.649399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4ae815ea-46dd-4aa3-9fdc-ab9f7d7ad89f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.177768 Aug 30 00:01:26.650329 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 522/1059] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:26 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:27.156838 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1158882385", "imageRef": "f6a316e9-3107-4298-8ae2-cf6e33d76546", "flavorRef": "452", "networks": [{"uuid": "c9ec0f26-0bf4-4e7f-95ac-3f35cbd77e6d"}]}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:27.214032 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] validate_networks() for [('c9ec0f26-0bf4-4e7f-95ac-3f35cbd77e6d', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:01:27.661651 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:01:27.662073 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:01:27.662620 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:01:27.663038 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:01:27.663454 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:01:27.671129 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-146bba2c-c07d-4972-96c5-b26a1c139653 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:27.671777 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-146bba2c-c07d-4972-96c5-b26a1c139653 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:27.673187 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.673683 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.674121 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.674889 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.675353 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.677047 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.679788 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-146bba2c-c07d-4972-96c5-b26a1c139653 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.680294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-146bba2c-c07d-4972-96c5-b26a1c139653 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.681211 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-146bba2c-c07d-4972-96c5-b26a1c139653 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.682135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-146bba2c-c07d-4972-96c5-b26a1c139653 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:27.682135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-146bba2c-c07d-4972-96c5-b26a1c139653 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:27.682324 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-146bba2c-c07d-4972-96c5-b26a1c139653 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:27.695089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Getting quotas for project 3771a66c80964a40805c3a9f1f51c3da. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:01:27.699887 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Getting quotas for user bf8fecbb57394e2e8f5dabfd75ac6b7c and project 3771a66c80964a40805c3a9f1f51c3da. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:01:27.712452 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:01:27.714938 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f6a316e9-3107-4298-8ae2-cf6e33d76546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:01:27.867018 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-146bba2c-c07d-4972-96c5-b26a1c139653 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:27.870336 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [25cdb20f-e5a8-44a7-9404-4dcd75793c5e] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 00:01:27.875133 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-146bba2c-c07d-4972-96c5-b26a1c139653 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.207901 Aug 30 00:01:27.875709 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 523/1060] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:27 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:28.878160 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO oslo.messaging._drivers.impl_rabbit [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [25cdb20f-e5a8-44a7-9404-4dcd75793c5e] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58158. Aug 30 00:01:28.883917 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ef4c86ec-b1a8-43c0-97b7-c45b9ecd65e8 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.730359 Aug 30 00:01:28.890466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 538/1061] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 30 00:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:01:28.895855 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1e419e5a-808b-4245-9f38-cda3bfb4c91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:28.896505 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1e419e5a-808b-4245-9f38-cda3bfb4c91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:28.906023 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-39256fe6-5317-4195-91f1-8eafd0dfefd9 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:28.906982 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-39256fe6-5317-4195-91f1-8eafd0dfefd9 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:28.932447 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39256fe6-5317-4195-91f1-8eafd0dfefd9 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.932949 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39256fe6-5317-4195-91f1-8eafd0dfefd9 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.933389 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39256fe6-5317-4195-91f1-8eafd0dfefd9 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.934322 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39256fe6-5317-4195-91f1-8eafd0dfefd9 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:28.935007 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39256fe6-5317-4195-91f1-8eafd0dfefd9 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:28.936351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39256fe6-5317-4195-91f1-8eafd0dfefd9 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:28.978015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1e419e5a-808b-4245-9f38-cda3bfb4c91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:28.985638 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1e419e5a-808b-4245-9f38-cda3bfb4c91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1219 microversion: 2.1 time: 0.093728 Aug 30 00:01:28.987643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 524/1062] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:28 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:29.117271 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-39256fe6-5317-4195-91f1-8eafd0dfefd9 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:29.131164 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-39256fe6-5317-4195-91f1-8eafd0dfefd9 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.228834 Aug 30 00:01:29.134155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 539/1063] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:28 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:30.007925 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-73e096ee-09b2-46e7-8009-a23a171dc433 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:30.008517 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-73e096ee-09b2-46e7-8009-a23a171dc433 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:30.067864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-73e096ee-09b2-46e7-8009-a23a171dc433 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:30.075321 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-73e096ee-09b2-46e7-8009-a23a171dc433 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1219 microversion: 2.1 time: 0.071858 Aug 30 00:01:30.076030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 525/1064] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:30 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:30.155281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-bbe843c8-5e36-4b6c-939e-039663821c6c tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:30.155905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-bbe843c8-5e36-4b6c-939e-039663821c6c tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:30.163253 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bbe843c8-5e36-4b6c-939e-039663821c6c tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:30.166452 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bbe843c8-5e36-4b6c-939e-039663821c6c tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:30.166452 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bbe843c8-5e36-4b6c-939e-039663821c6c tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:30.166452 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bbe843c8-5e36-4b6c-939e-039663821c6c tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:30.166452 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bbe843c8-5e36-4b6c-939e-039663821c6c tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:30.167006 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bbe843c8-5e36-4b6c-939e-039663821c6c tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:30.185774 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:30.317802 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bbe843c8-5e36-4b6c-939e-039663821c6c tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:30.326291 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-bbe843c8-5e36-4b6c-939e-039663821c6c tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.174861 Aug 30 00:01:30.326903 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 540/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:30 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:31.096913 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-feac7509-c773-4698-9143-b36c6aa44729 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:31.098240 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-feac7509-c773-4698-9143-b36c6aa44729 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:31.105920 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-feac7509-c773-4698-9143-b36c6aa44729 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.106601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-feac7509-c773-4698-9143-b36c6aa44729 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.107046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-feac7509-c773-4698-9143-b36c6aa44729 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.107766 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-feac7509-c773-4698-9143-b36c6aa44729 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.108223 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-feac7509-c773-4698-9143-b36c6aa44729 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.108650 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-feac7509-c773-4698-9143-b36c6aa44729 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.177089 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-de51433e-829a-45ce-abe9-efa05760c481 req-e7163edc-eb9c-40fc-86f0-20b5327ddd97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f051f8-b22f-462d-9638-085850018918", "name": "network-vif-plugged", "status": "completed", "tag": "a37b351a-0c4d-40e1-805b-bd45bbb90500"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:31.189694 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-de51433e-829a-45ce-abe9-efa05760c481 req-e7163edc-eb9c-40fc-86f0-20b5327ddd97 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.191828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-de51433e-829a-45ce-abe9-efa05760c481 req-e7163edc-eb9c-40fc-86f0-20b5327ddd97 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.191828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-de51433e-829a-45ce-abe9-efa05760c481 req-e7163edc-eb9c-40fc-86f0-20b5327ddd97 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.197514 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-feac7509-c773-4698-9143-b36c6aa44729 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:31.203179 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-de51433e-829a-45ce-abe9-efa05760c481 req-e7163edc-eb9c-40fc-86f0-20b5327ddd97 service nova] Creating event network-vif-plugged:a37b351a-0c4d-40e1-805b-bd45bbb90500 for instance c8f051f8-b22f-462d-9638-085850018918 on hv-cinder-85427 Aug 30 00:01:31.205397 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-feac7509-c773-4698-9143-b36c6aa44729 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1271 microversion: 2.1 time: 0.112678 Aug 30 00:01:31.205986 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 526/1066] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:31 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:31.209431 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-de51433e-829a-45ce-abe9-efa05760c481 req-e7163edc-eb9c-40fc-86f0-20b5327ddd97 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038528 Aug 30 00:01:31.210080 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 541/1067] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:01:31.348648 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6d8e9564-34cc-4969-96f0-54c110d430e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:31.349291 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6d8e9564-34cc-4969-96f0-54c110d430e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:31.355618 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6d8e9564-34cc-4969-96f0-54c110d430e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.356100 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6d8e9564-34cc-4969-96f0-54c110d430e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.356530 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6d8e9564-34cc-4969-96f0-54c110d430e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.357220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6d8e9564-34cc-4969-96f0-54c110d430e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:31.357667 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6d8e9564-34cc-4969-96f0-54c110d430e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:31.358087 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6d8e9564-34cc-4969-96f0-54c110d430e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:31.511985 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6d8e9564-34cc-4969-96f0-54c110d430e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:31.521617 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6d8e9564-34cc-4969-96f0-54c110d430e3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.176084 Aug 30 00:01:31.522215 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 527/1068] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:31 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:32.230072 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fd1f3ca0-a160-43f3-b71c-32f6ae22acf1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:32.230864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fd1f3ca0-a160-43f3-b71c-32f6ae22acf1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:32.237466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd1f3ca0-a160-43f3-b71c-32f6ae22acf1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.238666 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd1f3ca0-a160-43f3-b71c-32f6ae22acf1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.239069 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd1f3ca0-a160-43f3-b71c-32f6ae22acf1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.239959 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd1f3ca0-a160-43f3-b71c-32f6ae22acf1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.240417 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd1f3ca0-a160-43f3-b71c-32f6ae22acf1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.240835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd1f3ca0-a160-43f3-b71c-32f6ae22acf1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.312498 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-fd1f3ca0-a160-43f3-b71c-32f6ae22acf1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:32.323604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fd1f3ca0-a160-43f3-b71c-32f6ae22acf1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1289 microversion: 2.1 time: 0.098445 Aug 30 00:01:32.325097 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 542/1069] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:32 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:32.544815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-dd9a7c67-7c4a-4f32-abe1-c7a3cbe01735 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:32.545724 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-dd9a7c67-7c4a-4f32-abe1-c7a3cbe01735 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:32.548397 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:32.554917 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dd9a7c67-7c4a-4f32-abe1-c7a3cbe01735 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.559707 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dd9a7c67-7c4a-4f32-abe1-c7a3cbe01735 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.559707 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dd9a7c67-7c4a-4f32-abe1-c7a3cbe01735 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.559707 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dd9a7c67-7c4a-4f32-abe1-c7a3cbe01735 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:32.559707 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dd9a7c67-7c4a-4f32-abe1-c7a3cbe01735 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:32.560426 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-dd9a7c67-7c4a-4f32-abe1-c7a3cbe01735 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:32.717849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-dd9a7c67-7c4a-4f32-abe1-c7a3cbe01735 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:32.726150 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-dd9a7c67-7c4a-4f32-abe1-c7a3cbe01735 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1266 microversion: 2.1 time: 0.186060 Aug 30 00:01:32.727046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 528/1070] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:32 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:33.369691 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-560f0f2f-cac8-43f2-a082-31387549bf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:33.371901 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-560f0f2f-cac8-43f2-a082-31387549bf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:33.383905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:33.386724 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-560f0f2f-cac8-43f2-a082-31387549bf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.387550 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-560f0f2f-cac8-43f2-a082-31387549bf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.388196 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-560f0f2f-cac8-43f2-a082-31387549bf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:33.389288 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-560f0f2f-cac8-43f2-a082-31387549bf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.389835 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-560f0f2f-cac8-43f2-a082-31387549bf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.390633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-560f0f2f-cac8-43f2-a082-31387549bf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:33.560183 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-560f0f2f-cac8-43f2-a082-31387549bf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:33.568814 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-560f0f2f-cac8-43f2-a082-31387549bf7e tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1319 microversion: 2.1 time: 0.210271 Aug 30 00:01:33.572502 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 543/1071] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:33 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:33.754077 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-63879ea2-197b-4a7e-b4ae-b422e718b9b3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:33.756072 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-63879ea2-197b-4a7e-b4ae-b422e718b9b3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:33.772235 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63879ea2-197b-4a7e-b4ae-b422e718b9b3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.772235 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63879ea2-197b-4a7e-b4ae-b422e718b9b3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.772235 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63879ea2-197b-4a7e-b4ae-b422e718b9b3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:33.772235 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63879ea2-197b-4a7e-b4ae-b422e718b9b3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.773983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63879ea2-197b-4a7e-b4ae-b422e718b9b3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.773983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-63879ea2-197b-4a7e-b4ae-b422e718b9b3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:33.953989 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-63879ea2-197b-4a7e-b4ae-b422e718b9b3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:33.965498 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-63879ea2-197b-4a7e-b4ae-b422e718b9b3 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1454 microversion: 2.1 time: 0.218352 Aug 30 00:01:33.965498 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 529/1072] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:33 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1454 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:33.987317 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-6cbdee83-5bb0-4ae2-8495-084eec5a2e3d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:33.987938 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-6cbdee83-5bb0-4ae2-8495-084eec5a2e3d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:33.995913 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cbdee83-5bb0-4ae2-8495-084eec5a2e3d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:33.996849 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cbdee83-5bb0-4ae2-8495-084eec5a2e3d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:33.997647 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cbdee83-5bb0-4ae2-8495-084eec5a2e3d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:33.999348 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cbdee83-5bb0-4ae2-8495-084eec5a2e3d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:34.000085 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cbdee83-5bb0-4ae2-8495-084eec5a2e3d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:34.000822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-6cbdee83-5bb0-4ae2-8495-084eec5a2e3d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:34.172777 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-6cbdee83-5bb0-4ae2-8495-084eec5a2e3d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:34.181400 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-6cbdee83-5bb0-4ae2-8495-084eec5a2e3d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1454 microversion: 2.1 time: 0.198476 Aug 30 00:01:34.182009 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 544/1073] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:33 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1454 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:34.250147 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-41093271-faad-4618-83f4-ae7e9c5f90f3 req-1373ae9c-ae14-4236-a6df-1fefd517520b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422ec8ce-b33e-4ccc-9820-312e049e6467", "tag": "272c2324-6b3a-41bc-a98a-b5a31630898d"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:34.269066 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-41093271-faad-4618-83f4-ae7e9c5f90f3 req-1373ae9c-ae14-4236-a6df-1fefd517520b service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:34.269995 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-41093271-faad-4618-83f4-ae7e9c5f90f3 req-1373ae9c-ae14-4236-a6df-1fefd517520b service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:34.270902 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-41093271-faad-4618-83f4-ae7e9c5f90f3 req-1373ae9c-ae14-4236-a6df-1fefd517520b service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:34.289012 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-41093271-faad-4618-83f4-ae7e9c5f90f3 req-1373ae9c-ae14-4236-a6df-1fefd517520b service nova] Creating event network-changed:272c2324-6b3a-41bc-a98a-b5a31630898d for instance 422ec8ce-b33e-4ccc-9820-312e049e6467 on hv-cinder-85427 Aug 30 00:01:34.296232 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-41093271-faad-4618-83f4-ae7e9c5f90f3 req-1373ae9c-ae14-4236-a6df-1fefd517520b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050678 Aug 30 00:01:34.297813 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 530/1074] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:34.595029 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f8ee25ad-7561-4855-9aad-b1cc34828bdf tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:34.596408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f8ee25ad-7561-4855-9aad-b1cc34828bdf tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:34.609669 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f8ee25ad-7561-4855-9aad-b1cc34828bdf tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:34.610548 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f8ee25ad-7561-4855-9aad-b1cc34828bdf tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:34.611318 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f8ee25ad-7561-4855-9aad-b1cc34828bdf tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:34.612570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f8ee25ad-7561-4855-9aad-b1cc34828bdf tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:34.613140 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f8ee25ad-7561-4855-9aad-b1cc34828bdf tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:34.613884 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f8ee25ad-7561-4855-9aad-b1cc34828bdf tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:35.228692 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f8ee25ad-7561-4855-9aad-b1cc34828bdf tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:35.238745 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f8ee25ad-7561-4855-9aad-b1cc34828bdf tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1319 microversion: 2.1 time: 0.651284 Aug 30 00:01:35.239453 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 545/1075] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:34 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1319 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:36.261673 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f4fdea51-9393-4b21-a08d-d7d404145a38 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:36.262386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f4fdea51-9393-4b21-a08d-d7d404145a38 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:36.275350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4fdea51-9393-4b21-a08d-d7d404145a38 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.276185 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4fdea51-9393-4b21-a08d-d7d404145a38 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.276631 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4fdea51-9393-4b21-a08d-d7d404145a38 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.277535 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4fdea51-9393-4b21-a08d-d7d404145a38 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:36.278149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4fdea51-9393-4b21-a08d-d7d404145a38 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:36.278440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f4fdea51-9393-4b21-a08d-d7d404145a38 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:36.528897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f4fdea51-9393-4b21-a08d-d7d404145a38 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:36.539439 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f4fdea51-9393-4b21-a08d-d7d404145a38 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1319 microversion: 2.1 time: 0.282496 Aug 30 00:01:36.540341 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 531/1076] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:36 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:37.021528 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-568ca0e5-384d-45e9-99b9-7707ce6c8f8a req-5b217eb7-89ba-48ec-a604-4f1806c03ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f051f8-b22f-462d-9638-085850018918", "tag": "a37b351a-0c4d-40e1-805b-bd45bbb90500"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:37.032002 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-568ca0e5-384d-45e9-99b9-7707ce6c8f8a req-5b217eb7-89ba-48ec-a604-4f1806c03ddb service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:37.032819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-568ca0e5-384d-45e9-99b9-7707ce6c8f8a req-5b217eb7-89ba-48ec-a604-4f1806c03ddb service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:37.033256 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-568ca0e5-384d-45e9-99b9-7707ce6c8f8a req-5b217eb7-89ba-48ec-a604-4f1806c03ddb service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:37.045708 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-568ca0e5-384d-45e9-99b9-7707ce6c8f8a req-5b217eb7-89ba-48ec-a604-4f1806c03ddb service nova] Creating event network-changed:a37b351a-0c4d-40e1-805b-bd45bbb90500 for instance c8f051f8-b22f-462d-9638-085850018918 on hv-cinder-85427 Aug 30 00:01:37.052055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-568ca0e5-384d-45e9-99b9-7707ce6c8f8a req-5b217eb7-89ba-48ec-a604-4f1806c03ddb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033488 Aug 30 00:01:37.052904 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 546/1077] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:37.564448 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-172d7207-fe66-4c57-9df0-3fa0a869c407 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:37.565332 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-172d7207-fe66-4c57-9df0-3fa0a869c407 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:37.575232 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-172d7207-fe66-4c57-9df0-3fa0a869c407 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:37.576237 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-172d7207-fe66-4c57-9df0-3fa0a869c407 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:37.581915 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-172d7207-fe66-4c57-9df0-3fa0a869c407 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:37.581915 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-172d7207-fe66-4c57-9df0-3fa0a869c407 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:37.581915 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-172d7207-fe66-4c57-9df0-3fa0a869c407 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:37.581915 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-172d7207-fe66-4c57-9df0-3fa0a869c407 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:37.766215 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-172d7207-fe66-4c57-9df0-3fa0a869c407 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:37.778507 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-172d7207-fe66-4c57-9df0-3fa0a869c407 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1319 microversion: 2.1 time: 0.219440 Aug 30 00:01:37.782631 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 532/1078] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:37 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:38.797476 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:38.798262 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=6 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:38.803132 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-1f41e90b-d7e9-4cff-822e-874f25748223 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:38.803843 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-1f41e90b-d7e9-4cff-822e-874f25748223 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:38.810742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f41e90b-d7e9-4cff-822e-874f25748223 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:38.811233 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f41e90b-d7e9-4cff-822e-874f25748223 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:38.811668 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f41e90b-d7e9-4cff-822e-874f25748223 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:38.812380 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f41e90b-d7e9-4cff-822e-874f25748223 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:38.812830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f41e90b-d7e9-4cff-822e-874f25748223 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:38.813250 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-1f41e90b-d7e9-4cff-822e-874f25748223 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:38.961261 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-1f41e90b-d7e9-4cff-822e-874f25748223 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:38.969304 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-1f41e90b-d7e9-4cff-822e-874f25748223 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1319 microversion: 2.1 time: 0.172750 Aug 30 00:01:38.970232 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 547/1079] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:38 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:39.993381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-8811ac12-2de4-40bf-879e-c14e7fd27e63 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:39.994688 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-8811ac12-2de4-40bf-879e-c14e7fd27e63 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:40.001311 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8811ac12-2de4-40bf-879e-c14e7fd27e63 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:40.001798 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8811ac12-2de4-40bf-879e-c14e7fd27e63 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:40.002233 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8811ac12-2de4-40bf-879e-c14e7fd27e63 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:40.002972 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8811ac12-2de4-40bf-879e-c14e7fd27e63 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:40.003424 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8811ac12-2de4-40bf-879e-c14e7fd27e63 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:40.004025 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-8811ac12-2de4-40bf-879e-c14e7fd27e63 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:40.072439 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=4 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:40.163389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-8811ac12-2de4-40bf-879e-c14e7fd27e63 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:40.177105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-8811ac12-2de4-40bf-879e-c14e7fd27e63 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1319 microversion: 2.1 time: 0.187594 Aug 30 00:01:40.177960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 533/1080] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:39 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:41.199311 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-76be5b50-b8d1-4a94-9343-200188c212c1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:41.200398 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-76be5b50-b8d1-4a94-9343-200188c212c1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:41.204428 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-12051f1a-47d9-4167-a46e-c1b7145e0f5f req-00a3a25d-a8a3-4e0b-9355-73cc19092fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422ec8ce-b33e-4ccc-9820-312e049e6467", "name": "network-vif-plugged", "status": "completed", "tag": "272c2324-6b3a-41bc-a98a-b5a31630898d"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:41.207029 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-76be5b50-b8d1-4a94-9343-200188c212c1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.207531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-76be5b50-b8d1-4a94-9343-200188c212c1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.208031 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-76be5b50-b8d1-4a94-9343-200188c212c1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:41.208952 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-76be5b50-b8d1-4a94-9343-200188c212c1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.209584 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-76be5b50-b8d1-4a94-9343-200188c212c1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.210110 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-76be5b50-b8d1-4a94-9343-200188c212c1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:41.216111 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-12051f1a-47d9-4167-a46e-c1b7145e0f5f req-00a3a25d-a8a3-4e0b-9355-73cc19092fd6 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:41.216584 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-12051f1a-47d9-4167-a46e-c1b7145e0f5f req-00a3a25d-a8a3-4e0b-9355-73cc19092fd6 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:41.217178 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-12051f1a-47d9-4167-a46e-c1b7145e0f5f req-00a3a25d-a8a3-4e0b-9355-73cc19092fd6 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:41.230740 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-12051f1a-47d9-4167-a46e-c1b7145e0f5f req-00a3a25d-a8a3-4e0b-9355-73cc19092fd6 service nova] Creating event network-vif-plugged:272c2324-6b3a-41bc-a98a-b5a31630898d for instance 422ec8ce-b33e-4ccc-9820-312e049e6467 on hv-cinder-85427 Aug 30 00:01:41.239066 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-12051f1a-47d9-4167-a46e-c1b7145e0f5f req-00a3a25d-a8a3-4e0b-9355-73cc19092fd6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037182 Aug 30 00:01:41.240400 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 534/1081] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:01:41.371806 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-76be5b50-b8d1-4a94-9343-200188c212c1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:41.383456 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-76be5b50-b8d1-4a94-9343-200188c212c1 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1319 microversion: 2.1 time: 0.188713 Aug 30 00:01:41.384027 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 548/1082] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:41 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:42.405690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-21323efd-20a8-4620-a327-3cad41227709 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:42.406366 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-21323efd-20a8-4620-a327-3cad41227709 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:42.413899 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-21323efd-20a8-4620-a327-3cad41227709 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:42.414391 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-21323efd-20a8-4620-a327-3cad41227709 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:42.414856 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-21323efd-20a8-4620-a327-3cad41227709 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:42.415558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-21323efd-20a8-4620-a327-3cad41227709 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:42.416007 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-21323efd-20a8-4620-a327-3cad41227709 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:42.416428 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-21323efd-20a8-4620-a327-3cad41227709 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:42.562961 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-21323efd-20a8-4620-a327-3cad41227709 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:42.572767 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-21323efd-20a8-4620-a327-3cad41227709 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1319 microversion: 2.1 time: 0.171239 Aug 30 00:01:42.573357 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 535/1083] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:42 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:43.593546 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2dda00e4-03c0-4e98-b4e4-c4f9c350b91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:01:43.594216 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2dda00e4-03c0-4e98-b4e4-c4f9c350b91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:43.601593 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2dda00e4-03c0-4e98-b4e4-c4f9c350b91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.602354 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2dda00e4-03c0-4e98-b4e4-c4f9c350b91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.602825 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2dda00e4-03c0-4e98-b4e4-c4f9c350b91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:43.603555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2dda00e4-03c0-4e98-b4e4-c4f9c350b91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.604007 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2dda00e4-03c0-4e98-b4e4-c4f9c350b91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.604434 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2dda00e4-03c0-4e98-b4e4-c4f9c350b91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:43.750529 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2dda00e4-03c0-4e98-b4e4-c4f9c350b91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:01:43.758250 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2dda00e4-03c0-4e98-b4e4-c4f9c350b91f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1508 microversion: 2.1 time: 0.168725 Aug 30 00:01:43.758860 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 549/1084] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:01:43 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:43.778248 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c851ab0e-c9e3-441a-8fcd-4c7c4cf3dbcd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "203c082e-f118-4ceb-82b2-6f6a54ea6374", "device": "/dev/sdb"}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:01:43.781210 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c851ab0e-c9e3-441a-8fcd-4c7c4cf3dbcd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:01:43.788510 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c851ab0e-c9e3-441a-8fcd-4c7c4cf3dbcd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.788989 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c851ab0e-c9e3-441a-8fcd-4c7c4cf3dbcd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.789420 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c851ab0e-c9e3-441a-8fcd-4c7c4cf3dbcd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:43.790113 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c851ab0e-c9e3-441a-8fcd-4c7c4cf3dbcd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:01:43.790613 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c851ab0e-c9e3-441a-8fcd-4c7c4cf3dbcd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:01:43.791032 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c851ab0e-c9e3-441a-8fcd-4c7c4cf3dbcd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:01:44.624921 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c851ab0e-c9e3-441a-8fcd-4c7c4cf3dbcd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "POST /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.850268 Aug 30 00:01:44.625586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 536/1085] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 30 00:01:43 2022] POST /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467/os-volume_attachments => generated 194 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:02:05.041863 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-56319ba1-b20f-433b-bbd9-c29ca9a88eda tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:05.043937 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-56319ba1-b20f-433b-bbd9-c29ca9a88eda tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:05.047388 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=13 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:05.048072 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=48 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:05.053824 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-56319ba1-b20f-433b-bbd9-c29ca9a88eda tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:05.054474 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-56319ba1-b20f-433b-bbd9-c29ca9a88eda tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:05.055012 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-56319ba1-b20f-433b-bbd9-c29ca9a88eda tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:05.055886 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-56319ba1-b20f-433b-bbd9-c29ca9a88eda tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:05.056515 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-56319ba1-b20f-433b-bbd9-c29ca9a88eda tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:05.057037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-56319ba1-b20f-433b-bbd9-c29ca9a88eda tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:05.150775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-56319ba1-b20f-433b-bbd9-c29ca9a88eda tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lazy-loading 'services' on Instance uuid 422ec8ce-b33e-4ccc-9820-312e049e6467 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:02:05.376705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-56319ba1-b20f-433b-bbd9-c29ca9a88eda tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "DELETE /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467/os-volume_attachments/203c082e-f118-4ceb-82b2-6f6a54ea6374" status: 202 len: 0 microversion: 2.1 time: 0.340395 Aug 30 00:02:05.377471 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 550/1086] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 30 00:02:05 2022] DELETE /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467/os-volume_attachments/203c082e-f118-4ceb-82b2-6f6a54ea6374 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:02:06.536857 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=17 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:06.537767 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:06.542788 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-35a81bae-0b32-4f5c-8940-319ede5a3401 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:06.543375 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-35a81bae-0b32-4f5c-8940-319ede5a3401 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:06.549899 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35a81bae-0b32-4f5c-8940-319ede5a3401 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:06.550379 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35a81bae-0b32-4f5c-8940-319ede5a3401 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:06.550837 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35a81bae-0b32-4f5c-8940-319ede5a3401 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:06.551546 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35a81bae-0b32-4f5c-8940-319ede5a3401 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:06.551989 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35a81bae-0b32-4f5c-8940-319ede5a3401 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:06.552420 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35a81bae-0b32-4f5c-8940-319ede5a3401 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:06.580531 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-35a81bae-0b32-4f5c-8940-319ede5a3401 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Going to try to terminate instance {{(pid=127706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:02:07.150447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-35a81bae-0b32-4f5c-8940-319ede5a3401 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "DELETE /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 204 len: 0 microversion: 2.1 time: 0.615480 Aug 30 00:02:07.151411 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 537/1087] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 30 00:02:06 2022] DELETE /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:07.160756 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-ae37bc4d-0f27-4491-8eaf-0d395f872f0d tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:07.164201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-ae37bc4d-0f27-4491-8eaf-0d395f872f0d tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:07.169319 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae37bc4d-0f27-4491-8eaf-0d395f872f0d tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:07.169843 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae37bc4d-0f27-4491-8eaf-0d395f872f0d tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:07.170279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae37bc4d-0f27-4491-8eaf-0d395f872f0d tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:07.171023 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae37bc4d-0f27-4491-8eaf-0d395f872f0d tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:07.171473 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae37bc4d-0f27-4491-8eaf-0d395f872f0d tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:07.171889 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-ae37bc4d-0f27-4491-8eaf-0d395f872f0d tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:07.324582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-ae37bc4d-0f27-4491-8eaf-0d395f872f0d tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:07.334524 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-ae37bc4d-0f27-4491-8eaf-0d395f872f0d tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1514 microversion: 2.1 time: 0.177943 Aug 30 00:02:07.335718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 551/1088] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:07 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:08.360270 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9c67ec74-a105-4c37-b148-6d67ea58c61f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:08.360970 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9c67ec74-a105-4c37-b148-6d67ea58c61f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:08.368712 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c67ec74-a105-4c37-b148-6d67ea58c61f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:08.369198 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c67ec74-a105-4c37-b148-6d67ea58c61f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:08.369632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c67ec74-a105-4c37-b148-6d67ea58c61f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:08.370500 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c67ec74-a105-4c37-b148-6d67ea58c61f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:08.370957 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c67ec74-a105-4c37-b148-6d67ea58c61f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:08.371386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9c67ec74-a105-4c37-b148-6d67ea58c61f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:08.509690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9c67ec74-a105-4c37-b148-6d67ea58c61f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:08.517938 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9c67ec74-a105-4c37-b148-6d67ea58c61f tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1514 microversion: 2.1 time: 0.163035 Aug 30 00:02:08.518551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 538/1089] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:08 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:09.541658 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-39f905d3-5a5f-4b31-aa56-0d48031d031a tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:09.542853 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-39f905d3-5a5f-4b31-aa56-0d48031d031a tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:09.557800 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39f905d3-5a5f-4b31-aa56-0d48031d031a tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.558371 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39f905d3-5a5f-4b31-aa56-0d48031d031a tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.558906 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39f905d3-5a5f-4b31-aa56-0d48031d031a tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.559703 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39f905d3-5a5f-4b31-aa56-0d48031d031a tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.560225 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39f905d3-5a5f-4b31-aa56-0d48031d031a tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.560785 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-39f905d3-5a5f-4b31-aa56-0d48031d031a tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.590779 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-d0b1da3d-ce26-4439-bcdb-9b2df5c6f673 req-4ea1cfe0-8734-43c0-820d-363812407032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422ec8ce-b33e-4ccc-9820-312e049e6467", "name": "network-vif-deleted", "tag": "272c2324-6b3a-41bc-a98a-b5a31630898d"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:09.606371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-d0b1da3d-ce26-4439-bcdb-9b2df5c6f673 req-4ea1cfe0-8734-43c0-820d-363812407032 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:09.606371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-d0b1da3d-ce26-4439-bcdb-9b2df5c6f673 req-4ea1cfe0-8734-43c0-820d-363812407032 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:09.606371 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-d0b1da3d-ce26-4439-bcdb-9b2df5c6f673 req-4ea1cfe0-8734-43c0-820d-363812407032 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:09.616982 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-d0b1da3d-ce26-4439-bcdb-9b2df5c6f673 req-4ea1cfe0-8734-43c0-820d-363812407032 service nova] Creating event network-vif-deleted:272c2324-6b3a-41bc-a98a-b5a31630898d for instance 422ec8ce-b33e-4ccc-9820-312e049e6467 on hv-cinder-85427 Aug 30 00:02:09.622031 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-d0b1da3d-ce26-4439-bcdb-9b2df5c6f673 req-4ea1cfe0-8734-43c0-820d-363812407032 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037174 Aug 30 00:02:09.622668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 539/1090] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:02:09.636314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-39f905d3-5a5f-4b31-aa56-0d48031d031a tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:09.644569 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-39f905d3-5a5f-4b31-aa56-0d48031d031a tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1472 microversion: 2.1 time: 0.109117 Aug 30 00:02:09.645141 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 552/1091] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:09 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1472 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:10.667878 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:10.668583 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:10.675233 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.675720 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.676149 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.676859 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.677310 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.677733 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.715937 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:10.716436 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:10.716870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:10.717330 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.objects.instance [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lazy-loading 'fault' on Instance uuid 422ec8ce-b33e-4ccc-9820-312e049e6467 {{(pid=127706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:02:10.767591 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8fecbb57394e2e8f5dabfd75ac6b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3771a66c80964a40805c3a9f1f51c3da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:02:10.778777 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2444ede9-7278-43b6-ad52-908db88bb7c6 tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 200 len: 1309 microversion: 2.1 time: 0.116347 Aug 30 00:02:10.779375 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 540/1092] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:10 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:11.807662 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:02:11.808278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] [instance: 422ec8ce-b33e-4ccc-9820-312e049e6467] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:02:11.814862 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:11.815346 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:11.815773 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:11.816485 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:02:11.816935 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:02:11.817351 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:02:11.832316 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] HTTP exception thrown: Instance 422ec8ce-b33e-4ccc-9820-312e049e6467 could not be found. Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Request method failure captured: Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 HTTP/1.1 Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVMIF4GrR-nPDpOeun4sq0NdAq259DMoS8dy3ADrnd8nWJITN800inquP2Mq9ApfXXlFzYsk59Tox0jOVmDV96kJO6zsIn-lKDqVmGS9ha76eoOky73RW6Pekh1tO2tJoFcwAMdmHgF9Pwv7timcCRDTTaLOpDhg4pHH7IGcdB3WYgk Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: 3771a66c80964a40805c3a9f1f51c3da Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-VolumesSnapshotTestJSON-925763777 Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 30 00:02:11.833983 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3771a66c80964a40805c3a9f1f51c3da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3771a66c80964a40805c3a9f1f51c3da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3771a66c80964a40805c3a9f1f51c3da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3771a66c80964a40805c3a9f1f51c3da", "adminURL": "http://10.222.0.58:8080"}]}] Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-VolumesSnapshotTestJSON-925763777 Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: 3771a66c80964a40805c3a9f1f51c3da Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-925763777 Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-VolumesSnapshotTestJSON-925763777-project Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: bf8fecbb57394e2e8f5dabfd75ac6b7c Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-VolumesSnapshotTestJSON-925763777-project Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 422ec8ce-b33e-4ccc-9820-312e049e6467 could not be found. Aug 30 00:02:11.835928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '422ec8ce-b33e-4ccc-9820-312e049e6467'} Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422ec8ce-b33e-4ccc-9820-312e049e6467 could not be found. Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:02:11.837108 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422ec8ce-b33e-4ccc-9820-312e049e6467 could not be found. Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422ec8ce-b33e-4ccc-9820-312e049e6467 could not be found. Aug 30 00:02:11.838759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:02:11.840206 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] Returning 404 to user: Instance 422ec8ce-b33e-4ccc-9820-312e049e6467 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:02:11.840206 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-dcc70372-c959-4ce7-8b8d-94dcf535e0bd tempest-VolumesSnapshotTestJSON-925763777 tempest-VolumesSnapshotTestJSON-925763777-project] 10.222.0.58 "GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467" status: 404 len: 111 microversion: 2.1 time: 0.033069 Aug 30 00:02:11.840206 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 553/1093] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:02:11 2022] GET /compute/v2.1/servers/422ec8ce-b33e-4ccc-9820-312e049e6467 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:02:52.721996 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:52.723308 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:52.900013 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-720a0c8e-d1ed-4766-a9e7-da272f41641d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Action: 'create', calling method: .version_select at 0x7fabbdfe1310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1388111469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIOEEkQ9cwaBKAx3lPsL4UHVHJC7Ua+BVgZoPxs2yphCo1REhYbAUemYTKbHxF0PHscmENpwGUHz1C3e3B11xSoJSNc8o5WLlcRefiEhxPGenjHFxt1RFUqaoRM92UkCw=="}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:02:52.917485 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-720a0c8e-d1ed-4766-a9e7-da272f41641d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Getting quotas for project 6516b21ff0b6423cbed032257af13839. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:02:52.924346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-720a0c8e-d1ed-4766-a9e7-da272f41641d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Getting quotas for user 6825bc701a46434d8bc9dd62c203ec83 and project 6516b21ff0b6423cbed032257af13839. Resources: {'key_pairs'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:02:53.006145 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-720a0c8e-d1ed-4766-a9e7-da272f41641d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.290282 Aug 30 00:02:53.006788 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 541/1094] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 30 00:02:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:13.464675 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=8 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:13.465419 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:13.470027 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-414209486", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1388111469", "security_groups": [{"name": "tempest-secgroup-smoke-2053756406"}], "networks": [{"uuid": "b1bf2eda-aa11-4aef-b798-dafffe73963a"}], "block_device_mapping_v2": [{"uuid": "0afa55b5-c0c7-41b3-bb57-821639911c3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:13.588044 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.network.neutron [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] validate_networks() for [('b1bf2eda-aa11-4aef-b798-dafffe73963a', None, None, None, None, None)] {{(pid=127705) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:03:14.060909 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Flavor limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:03:14.061373 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Image limits 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:03:14.061912 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Flavor pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:03:14.062481 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Image pref 0:0:0 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:03:14.062985 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.virt.hardware [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:03:14.071825 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:14.072304 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:14.072736 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:14.073464 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:14.073919 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:14.074341 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:14.090954 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Getting quotas for project 6516b21ff0b6423cbed032257af13839. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:03:14.095457 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.quota [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Getting quotas for user 6825bc701a46434d8bc9dd62c203ec83 and project 6516b21ff0b6423cbed032257af13839. Resources: {'instances', 'cores', 'ram'} {{(pid=127705) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:03:14.153606 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Going to run 1 instances... {{(pid=127705) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:03:14.156370 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0afa55b5-c0c7-41b3-bb57-821639911c3c',volume_size=None,volume_type=None)] {{(pid=127705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:03:14.575325 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-99db1fe5-723b-4857-baf6-aee8b575b9ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.112431 Aug 30 00:03:14.579957 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 554/1095] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 30 00:03:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:03:14.585395 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=4 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:14.586136 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:14.590797 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6527d517-9212-4cf6-8a0f-fcd5d5cdfcb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:14.593235 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6527d517-9212-4cf6-8a0f-fcd5d5cdfcb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:14.670360 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6527d517-9212-4cf6-8a0f-fcd5d5cdfcb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:14.679229 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6527d517-9212-4cf6-8a0f-fcd5d5cdfcb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1088 microversion: 2.1 time: 0.095428 Aug 30 00:03:14.689201 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 542/1096] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:14 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1088 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:15.700589 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-44832de6-5263-4940-8fee-e7076e44f192 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:15.701135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-44832de6-5263-4940-8fee-e7076e44f192 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:15.709100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44832de6-5263-4940-8fee-e7076e44f192 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:15.715102 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44832de6-5263-4940-8fee-e7076e44f192 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:15.715102 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44832de6-5263-4940-8fee-e7076e44f192 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:15.715102 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44832de6-5263-4940-8fee-e7076e44f192 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:15.715102 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44832de6-5263-4940-8fee-e7076e44f192 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:15.715530 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44832de6-5263-4940-8fee-e7076e44f192 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:15.774620 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-44832de6-5263-4940-8fee-e7076e44f192 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:15.782911 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-44832de6-5263-4940-8fee-e7076e44f192 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1138 microversion: 2.1 time: 0.086839 Aug 30 00:03:15.783489 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 555/1097] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:15 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:16.803752 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e1a4576b-a7b0-49b3-8bb6-b5c5cc5a6c3e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:16.804341 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e1a4576b-a7b0-49b3-8bb6-b5c5cc5a6c3e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:16.811196 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e1a4576b-a7b0-49b3-8bb6-b5c5cc5a6c3e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:16.811676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e1a4576b-a7b0-49b3-8bb6-b5c5cc5a6c3e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:16.812108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e1a4576b-a7b0-49b3-8bb6-b5c5cc5a6c3e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:16.813001 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e1a4576b-a7b0-49b3-8bb6-b5c5cc5a6c3e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:16.813475 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e1a4576b-a7b0-49b3-8bb6-b5c5cc5a6c3e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:16.813923 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e1a4576b-a7b0-49b3-8bb6-b5c5cc5a6c3e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:16.877978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-e1a4576b-a7b0-49b3-8bb6-b5c5cc5a6c3e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:16.886968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e1a4576b-a7b0-49b3-8bb6-b5c5cc5a6c3e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1186 microversion: 2.1 time: 0.087603 Aug 30 00:03:16.887586 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 543/1098] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:16 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:17.908962 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-090ea0e0-6ba7-4553-91a6-55109d912953 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:17.909633 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-090ea0e0-6ba7-4553-91a6-55109d912953 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:17.916445 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-090ea0e0-6ba7-4553-91a6-55109d912953 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:17.916924 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-090ea0e0-6ba7-4553-91a6-55109d912953 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:17.917549 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-090ea0e0-6ba7-4553-91a6-55109d912953 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:17.918247 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-090ea0e0-6ba7-4553-91a6-55109d912953 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:17.918771 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-090ea0e0-6ba7-4553-91a6-55109d912953 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:17.919720 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-090ea0e0-6ba7-4553-91a6-55109d912953 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:18.088827 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-090ea0e0-6ba7-4553-91a6-55109d912953 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:18.098520 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-090ea0e0-6ba7-4553-91a6-55109d912953 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1272 microversion: 2.1 time: 0.193963 Aug 30 00:03:18.099245 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 556/1099] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:17 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:18.702373 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-9d40495c-7458-4546-8da4-b1b948bbc229 req-b92c7c7b-ee21-4de0-bd0d-30a0b8408e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4f99d9-6f44-41d0-ab65-7464370d9d52", "tag": "d8e2f48a-54fa-4f95-996f-1ce84820f6ed"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:18.713046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-9d40495c-7458-4546-8da4-b1b948bbc229 req-b92c7c7b-ee21-4de0-bd0d-30a0b8408e54 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:18.721837 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-9d40495c-7458-4546-8da4-b1b948bbc229 req-b92c7c7b-ee21-4de0-bd0d-30a0b8408e54 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:18.721837 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-9d40495c-7458-4546-8da4-b1b948bbc229 req-b92c7c7b-ee21-4de0-bd0d-30a0b8408e54 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:18.728253 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-9d40495c-7458-4546-8da4-b1b948bbc229 req-b92c7c7b-ee21-4de0-bd0d-30a0b8408e54 service nova] Creating event network-changed:d8e2f48a-54fa-4f95-996f-1ce84820f6ed for instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 on hv-cinder-85427 Aug 30 00:03:18.734929 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-9d40495c-7458-4546-8da4-b1b948bbc229 req-b92c7c7b-ee21-4de0-bd0d-30a0b8408e54 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039356 Aug 30 00:03:18.735736 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 544/1100] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:19.120441 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-dc788a0f-26bf-4f3f-8408-4f9c30f27771 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:19.121039 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-dc788a0f-26bf-4f3f-8408-4f9c30f27771 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:19.128240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc788a0f-26bf-4f3f-8408-4f9c30f27771 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:19.128729 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc788a0f-26bf-4f3f-8408-4f9c30f27771 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:19.129157 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc788a0f-26bf-4f3f-8408-4f9c30f27771 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:19.129853 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc788a0f-26bf-4f3f-8408-4f9c30f27771 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:19.130301 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc788a0f-26bf-4f3f-8408-4f9c30f27771 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:19.130752 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-dc788a0f-26bf-4f3f-8408-4f9c30f27771 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:19.266058 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-dc788a0f-26bf-4f3f-8408-4f9c30f27771 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:19.274234 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-dc788a0f-26bf-4f3f-8408-4f9c30f27771 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.157529 Aug 30 00:03:19.274750 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 557/1101] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:19 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:20.296230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-0a1506e4-cfce-4bb8-bd9e-8b16ec955949 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:20.297350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-0a1506e4-cfce-4bb8-bd9e-8b16ec955949 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:20.303374 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0a1506e4-cfce-4bb8-bd9e-8b16ec955949 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:20.303850 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0a1506e4-cfce-4bb8-bd9e-8b16ec955949 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:20.304305 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0a1506e4-cfce-4bb8-bd9e-8b16ec955949 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:20.304990 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0a1506e4-cfce-4bb8-bd9e-8b16ec955949 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:20.305431 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0a1506e4-cfce-4bb8-bd9e-8b16ec955949 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:20.305878 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-0a1506e4-cfce-4bb8-bd9e-8b16ec955949 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:20.442610 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-0a1506e4-cfce-4bb8-bd9e-8b16ec955949 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:20.450288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-0a1506e4-cfce-4bb8-bd9e-8b16ec955949 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.158700 Aug 30 00:03:20.450882 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 545/1102] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:20 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:21.471110 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0303f010-f86e-4c07-93e4-d01eec743855 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:21.471759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0303f010-f86e-4c07-93e4-d01eec743855 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:21.478274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0303f010-f86e-4c07-93e4-d01eec743855 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:21.478788 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0303f010-f86e-4c07-93e4-d01eec743855 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:21.479222 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0303f010-f86e-4c07-93e4-d01eec743855 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:21.479924 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0303f010-f86e-4c07-93e4-d01eec743855 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:21.480370 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0303f010-f86e-4c07-93e4-d01eec743855 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:21.480789 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0303f010-f86e-4c07-93e4-d01eec743855 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:21.627553 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0303f010-f86e-4c07-93e4-d01eec743855 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:21.635333 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0303f010-f86e-4c07-93e4-d01eec743855 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.168543 Aug 30 00:03:21.635900 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 558/1103] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:21 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:22.658523 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-fbfd7219-a2c2-4e06-a463-29d73280e607 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:22.659542 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-fbfd7219-a2c2-4e06-a463-29d73280e607 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:22.666159 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fbfd7219-a2c2-4e06-a463-29d73280e607 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:22.666676 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fbfd7219-a2c2-4e06-a463-29d73280e607 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:22.667105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fbfd7219-a2c2-4e06-a463-29d73280e607 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:22.667899 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fbfd7219-a2c2-4e06-a463-29d73280e607 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:22.668342 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fbfd7219-a2c2-4e06-a463-29d73280e607 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:22.668757 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-fbfd7219-a2c2-4e06-a463-29d73280e607 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:22.807012 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-fbfd7219-a2c2-4e06-a463-29d73280e607 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:22.815438 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-fbfd7219-a2c2-4e06-a463-29d73280e607 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.162499 Aug 30 00:03:22.816009 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 546/1104] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:22 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:23.837125 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-44722778-99f7-4d21-acc6-8daa66851e8b tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:23.837742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-44722778-99f7-4d21-acc6-8daa66851e8b tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:23.844587 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44722778-99f7-4d21-acc6-8daa66851e8b tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:23.845080 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44722778-99f7-4d21-acc6-8daa66851e8b tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:23.845515 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44722778-99f7-4d21-acc6-8daa66851e8b tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:23.846218 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44722778-99f7-4d21-acc6-8daa66851e8b tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:23.846703 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44722778-99f7-4d21-acc6-8daa66851e8b tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:23.847130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-44722778-99f7-4d21-acc6-8daa66851e8b tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:23.983055 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-44722778-99f7-4d21-acc6-8daa66851e8b tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:23.991302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-44722778-99f7-4d21-acc6-8daa66851e8b tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.158113 Aug 30 00:03:23.991869 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 559/1105] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:23 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:25.012826 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cdc7a06f-628e-4673-a7c1-149533ddfdfe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:25.013386 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-cdc7a06f-628e-4673-a7c1-149533ddfdfe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:25.020071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cdc7a06f-628e-4673-a7c1-149533ddfdfe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:25.020554 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cdc7a06f-628e-4673-a7c1-149533ddfdfe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:25.020988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cdc7a06f-628e-4673-a7c1-149533ddfdfe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:25.021682 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cdc7a06f-628e-4673-a7c1-149533ddfdfe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:25.022131 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cdc7a06f-628e-4673-a7c1-149533ddfdfe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:25.022588 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cdc7a06f-628e-4673-a7c1-149533ddfdfe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:25.153037 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-cdc7a06f-628e-4673-a7c1-149533ddfdfe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:25.160936 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-cdc7a06f-628e-4673-a7c1-149533ddfdfe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.152031 Aug 30 00:03:25.161502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 547/1106] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:25 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:26.182270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-99955ad2-1401-4387-8a39-d553f995ca44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:26.182870 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-99955ad2-1401-4387-8a39-d553f995ca44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:26.184686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:26.185347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=6 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:26.191235 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99955ad2-1401-4387-8a39-d553f995ca44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:26.194335 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99955ad2-1401-4387-8a39-d553f995ca44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:26.194335 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99955ad2-1401-4387-8a39-d553f995ca44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:26.194335 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99955ad2-1401-4387-8a39-d553f995ca44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:26.194335 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99955ad2-1401-4387-8a39-d553f995ca44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:26.194778 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-99955ad2-1401-4387-8a39-d553f995ca44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:26.331552 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-99955ad2-1401-4387-8a39-d553f995ca44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:26.339411 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-99955ad2-1401-4387-8a39-d553f995ca44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.161029 Aug 30 00:03:26.342775 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 560/1107] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:26 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:27.117491 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-71718985", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-406797152", "security_groups": [{"name": "tempest-secgroup-smoke-1075183352"}], "block_device_mapping_v2": [{"uuid": "ad896ea2-5ef1-42f6-94f6-946a7bbc597c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b98748d9-f76e-40ff-a76f-dd71e522597e"}]}} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:27.128368 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:27.236303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.network.neutron [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] validate_networks() for [('b98748d9-f76e-40ff-a76f-dd71e522597e', None, None, None, None, None)] {{(pid=127706) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:03:27.360413 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7e7d80b6-f061-417b-af3d-b655772333a6 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:27.361518 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7e7d80b6-f061-417b-af3d-b655772333a6 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:27.368569 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e7d80b6-f061-417b-af3d-b655772333a6 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:27.369056 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e7d80b6-f061-417b-af3d-b655772333a6 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:27.369602 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e7d80b6-f061-417b-af3d-b655772333a6 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:27.371164 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e7d80b6-f061-417b-af3d-b655772333a6 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:27.371632 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e7d80b6-f061-417b-af3d-b655772333a6 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:27.372060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7e7d80b6-f061-417b-af3d-b655772333a6 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:27.524504 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7e7d80b6-f061-417b-af3d-b655772333a6 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:27.533704 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7e7d80b6-f061-417b-af3d-b655772333a6 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.176519 Aug 30 00:03:27.534382 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 561/1108] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:27 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:27.708637 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Flavor limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:03:27.709049 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Image limits 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:03:27.709540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Flavor pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:03:27.709963 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Image pref 0:0:0 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:03:27.710604 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.virt.hardware [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:03:27.719170 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:27.719647 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:27.720314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:27.721211 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:27.721775 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:27.722216 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:27.739343 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Getting quotas for project c78ff4cbc0994af8855b1ac67cb281fe. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:03:27.743212 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.quota [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Getting quotas for user 1e63436f5691431d802706a8d5a6df7f and project c78ff4cbc0994af8855b1ac67cb281fe. Resources: {'instances', 'cores', 'ram'} {{(pid=127706) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:03:27.801284 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Going to run 1 instances... {{(pid=127706) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:03:27.803427 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ad896ea2-5ef1-42f6-94f6-946a7bbc597c',volume_size=None,volume_type=None)] {{(pid=127706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:03:28.277105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-e8345d60-82c3-4c2b-9e12-4f2451697b33 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.163376 Aug 30 00:03:28.277757 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 548/1109] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 30 00:03:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:03:28.289277 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f6af9854-d720-47c5-a119-7b9e8b677e48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:28.289979 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f6af9854-d720-47c5-a119-7b9e8b677e48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:28.554798 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-6c58fc9f-85ce-414a-a3f1-063160a54b93 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:28.555517 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-6c58fc9f-85ce-414a-a3f1-063160a54b93 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:28.561991 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c58fc9f-85ce-414a-a3f1-063160a54b93 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:28.562607 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c58fc9f-85ce-414a-a3f1-063160a54b93 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:28.563309 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c58fc9f-85ce-414a-a3f1-063160a54b93 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:28.564589 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c58fc9f-85ce-414a-a3f1-063160a54b93 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:28.565044 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c58fc9f-85ce-414a-a3f1-063160a54b93 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:28.565476 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-6c58fc9f-85ce-414a-a3f1-063160a54b93 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:28.621923 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f6af9854-d720-47c5-a119-7b9e8b677e48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:28.629130 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f6af9854-d720-47c5-a119-7b9e8b677e48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1092 microversion: 2.1 time: 0.343758 Aug 30 00:03:28.629712 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 562/1110] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:28 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1092 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:28.734646 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-6c58fc9f-85ce-414a-a3f1-063160a54b93 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:28.735551 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-6c58fc9f-85ce-414a-a3f1-063160a54b93 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.184684 Aug 30 00:03:28.736138 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 549/1111] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:28 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:29.650909 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9702b482-6b75-45f0-931e-e2b45759844a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:29.651553 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-9702b482-6b75-45f0-931e-e2b45759844a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:29.659718 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9702b482-6b75-45f0-931e-e2b45759844a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:29.660205 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9702b482-6b75-45f0-931e-e2b45759844a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:29.660663 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9702b482-6b75-45f0-931e-e2b45759844a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:29.661379 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9702b482-6b75-45f0-931e-e2b45759844a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:29.661907 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9702b482-6b75-45f0-931e-e2b45759844a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:29.662327 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-9702b482-6b75-45f0-931e-e2b45759844a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:29.727246 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-9702b482-6b75-45f0-931e-e2b45759844a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:29.735381 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9702b482-6b75-45f0-931e-e2b45759844a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1134 microversion: 2.1 time: 0.088781 Aug 30 00:03:29.735988 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 563/1112] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:29 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1134 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:29.756563 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-754fef51-7114-465a-ae96-302470bda1f5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:29.757164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-754fef51-7114-465a-ae96-302470bda1f5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:29.763277 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-754fef51-7114-465a-ae96-302470bda1f5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:29.763755 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-754fef51-7114-465a-ae96-302470bda1f5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:29.764181 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-754fef51-7114-465a-ae96-302470bda1f5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:29.764864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-754fef51-7114-465a-ae96-302470bda1f5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:29.765308 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-754fef51-7114-465a-ae96-302470bda1f5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:29.765726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-754fef51-7114-465a-ae96-302470bda1f5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:29.902599 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-754fef51-7114-465a-ae96-302470bda1f5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:29.910303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-754fef51-7114-465a-ae96-302470bda1f5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.157640 Aug 30 00:03:29.911017 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 550/1113] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:29 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:30.760030 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-999855bc-d3ba-46a7-8117-1d042af12d14 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:30.763661 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-999855bc-d3ba-46a7-8117-1d042af12d14 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:30.768472 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-999855bc-d3ba-46a7-8117-1d042af12d14 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.768953 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-999855bc-d3ba-46a7-8117-1d042af12d14 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.769495 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-999855bc-d3ba-46a7-8117-1d042af12d14 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.770448 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-999855bc-d3ba-46a7-8117-1d042af12d14 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.770895 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-999855bc-d3ba-46a7-8117-1d042af12d14 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.771510 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-999855bc-d3ba-46a7-8117-1d042af12d14 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.845579 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-999855bc-d3ba-46a7-8117-1d042af12d14 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:30.856874 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-999855bc-d3ba-46a7-8117-1d042af12d14 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1208 microversion: 2.1 time: 0.100714 Aug 30 00:03:30.857674 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 564/1114] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:30 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1208 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:30.931248 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9f66b1a3-ffcf-4381-867f-fa56e0ca4689 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:30.931873 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9f66b1a3-ffcf-4381-867f-fa56e0ca4689 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:30.939820 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f66b1a3-ffcf-4381-867f-fa56e0ca4689 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.940312 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f66b1a3-ffcf-4381-867f-fa56e0ca4689 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.940748 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f66b1a3-ffcf-4381-867f-fa56e0ca4689 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:30.941553 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f66b1a3-ffcf-4381-867f-fa56e0ca4689 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:30.942004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f66b1a3-ffcf-4381-867f-fa56e0ca4689 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:30.942447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9f66b1a3-ffcf-4381-867f-fa56e0ca4689 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:31.095304 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9f66b1a3-ffcf-4381-867f-fa56e0ca4689 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:31.103935 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9f66b1a3-ffcf-4381-867f-fa56e0ca4689 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.176725 Aug 30 00:03:31.109032 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 551/1115] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:30 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:31.887313 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-916a7734-50c1-41ba-8dc1-8c66a6371d48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:31.887928 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-916a7734-50c1-41ba-8dc1-8c66a6371d48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:31.895167 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-916a7734-50c1-41ba-8dc1-8c66a6371d48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:31.895872 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-916a7734-50c1-41ba-8dc1-8c66a6371d48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:31.896321 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-916a7734-50c1-41ba-8dc1-8c66a6371d48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:31.897021 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-916a7734-50c1-41ba-8dc1-8c66a6371d48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:31.897474 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-916a7734-50c1-41ba-8dc1-8c66a6371d48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:31.897899 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-916a7734-50c1-41ba-8dc1-8c66a6371d48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.031460 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-916a7734-50c1-41ba-8dc1-8c66a6371d48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:32.039604 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-916a7734-50c1-41ba-8dc1-8c66a6371d48 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.156292 Aug 30 00:03:32.040169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 565/1116] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:31 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:32.125952 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-597aa83f-455f-4a3b-aad8-a4ff677b42b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:32.129452 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-597aa83f-455f-4a3b-aad8-a4ff677b42b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:32.136763 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597aa83f-455f-4a3b-aad8-a4ff677b42b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:32.137266 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597aa83f-455f-4a3b-aad8-a4ff677b42b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:32.139983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597aa83f-455f-4a3b-aad8-a4ff677b42b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.139983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597aa83f-455f-4a3b-aad8-a4ff677b42b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:32.139983 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597aa83f-455f-4a3b-aad8-a4ff677b42b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:32.140406 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-597aa83f-455f-4a3b-aad8-a4ff677b42b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.286841 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-597aa83f-455f-4a3b-aad8-a4ff677b42b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:32.295015 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-597aa83f-455f-4a3b-aad8-a4ff677b42b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.172993 Aug 30 00:03:32.295598 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 552/1117] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:32 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:32.366561 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-f43b5864-f7f0-4bbe-92b8-24ccd28cd76e req-0b9da943-327a-4829-afd3-6906a4e206b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79c5170-5e23-402b-9da6-706f8fad5507", "tag": "5f9f8076-cb47-4718-8b08-9ef61c33bd46"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:32.377611 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-f43b5864-f7f0-4bbe-92b8-24ccd28cd76e req-0b9da943-327a-4829-afd3-6906a4e206b3 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:32.381895 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-f43b5864-f7f0-4bbe-92b8-24ccd28cd76e req-0b9da943-327a-4829-afd3-6906a4e206b3 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:32.381895 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-f43b5864-f7f0-4bbe-92b8-24ccd28cd76e req-0b9da943-327a-4829-afd3-6906a4e206b3 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.398309 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-f43b5864-f7f0-4bbe-92b8-24ccd28cd76e req-0b9da943-327a-4829-afd3-6906a4e206b3 service nova] Creating event network-changed:5f9f8076-cb47-4718-8b08-9ef61c33bd46 for instance b79c5170-5e23-402b-9da6-706f8fad5507 on hv-cinder-85427 Aug 30 00:03:32.404577 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-f43b5864-f7f0-4bbe-92b8-24ccd28cd76e req-0b9da943-327a-4829-afd3-6906a4e206b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043961 Aug 30 00:03:32.405480 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 553/1118] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:03:32.409499 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-564b747f-d337-4fa0-ac3f-ee1fba26151c req-3c60bfce-8763-4c64-af01-a2d642f94ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4f99d9-6f44-41d0-ab65-7464370d9d52", "name": "network-vif-plugged", "status": "completed", "tag": "d8e2f48a-54fa-4f95-996f-1ce84820f6ed"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:32.419997 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-564b747f-d337-4fa0-ac3f-ee1fba26151c req-3c60bfce-8763-4c64-af01-a2d642f94ca5 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:32.420747 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-564b747f-d337-4fa0-ac3f-ee1fba26151c req-3c60bfce-8763-4c64-af01-a2d642f94ca5 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:32.421571 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-564b747f-d337-4fa0-ac3f-ee1fba26151c req-3c60bfce-8763-4c64-af01-a2d642f94ca5 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:32.435812 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-564b747f-d337-4fa0-ac3f-ee1fba26151c req-3c60bfce-8763-4c64-af01-a2d642f94ca5 service nova] Creating event network-vif-plugged:d8e2f48a-54fa-4f95-996f-1ce84820f6ed for instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 on hv-cinder-85427 Aug 30 00:03:32.442347 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-564b747f-d337-4fa0-ac3f-ee1fba26151c req-3c60bfce-8763-4c64-af01-a2d642f94ca5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108970 Aug 30 00:03:32.443237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 566/1119] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:33.061186 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-96d0521f-527d-4ee8-9abd-2828ae49b472 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:33.061883 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-96d0521f-527d-4ee8-9abd-2828ae49b472 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:33.068806 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96d0521f-527d-4ee8-9abd-2828ae49b472 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:33.069289 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96d0521f-527d-4ee8-9abd-2828ae49b472 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:33.069727 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96d0521f-527d-4ee8-9abd-2828ae49b472 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:33.070424 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96d0521f-527d-4ee8-9abd-2828ae49b472 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:33.070897 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96d0521f-527d-4ee8-9abd-2828ae49b472 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:33.071324 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-96d0521f-527d-4ee8-9abd-2828ae49b472 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:33.208994 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-96d0521f-527d-4ee8-9abd-2828ae49b472 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:33.216890 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-96d0521f-527d-4ee8-9abd-2828ae49b472 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.159883 Aug 30 00:03:33.217465 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 554/1120] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:33 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:33.317914 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-534b3497-de07-496d-954b-028713b03feb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:33.318696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-534b3497-de07-496d-954b-028713b03feb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:33.330182 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-534b3497-de07-496d-954b-028713b03feb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:33.330693 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-534b3497-de07-496d-954b-028713b03feb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:33.331136 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-534b3497-de07-496d-954b-028713b03feb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:33.331838 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-534b3497-de07-496d-954b-028713b03feb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:33.332285 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-534b3497-de07-496d-954b-028713b03feb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:33.332705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-534b3497-de07-496d-954b-028713b03feb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:33.505374 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-534b3497-de07-496d-954b-028713b03feb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:33.513135 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-534b3497-de07-496d-954b-028713b03feb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1260 microversion: 2.1 time: 0.200095 Aug 30 00:03:33.513897 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 567/1121] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:33 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:34.238696 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d9f8b10e-2ff0-49d1-9adc-247cf4787c4d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:34.239343 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d9f8b10e-2ff0-49d1-9adc-247cf4787c4d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:34.245890 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d9f8b10e-2ff0-49d1-9adc-247cf4787c4d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.246446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d9f8b10e-2ff0-49d1-9adc-247cf4787c4d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.246888 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d9f8b10e-2ff0-49d1-9adc-247cf4787c4d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.247581 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d9f8b10e-2ff0-49d1-9adc-247cf4787c4d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.248034 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d9f8b10e-2ff0-49d1-9adc-247cf4787c4d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.248460 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d9f8b10e-2ff0-49d1-9adc-247cf4787c4d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.387391 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d9f8b10e-2ff0-49d1-9adc-247cf4787c4d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:34.396144 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d9f8b10e-2ff0-49d1-9adc-247cf4787c4d tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.161480 Aug 30 00:03:34.396720 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 555/1122] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:34 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:34.533546 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-e2fb3fb1-c8bb-40eb-ba16-0f937cfe48ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:34.535654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-e2fb3fb1-c8bb-40eb-ba16-0f937cfe48ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:34.540605 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e2fb3fb1-c8bb-40eb-ba16-0f937cfe48ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.541037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e2fb3fb1-c8bb-40eb-ba16-0f937cfe48ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.541593 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e2fb3fb1-c8bb-40eb-ba16-0f937cfe48ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.542290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e2fb3fb1-c8bb-40eb-ba16-0f937cfe48ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.542761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e2fb3fb1-c8bb-40eb-ba16-0f937cfe48ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.543177 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-e2fb3fb1-c8bb-40eb-ba16-0f937cfe48ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.685218 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-e2fb3fb1-c8bb-40eb-ba16-0f937cfe48ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:34.694287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-e2fb3fb1-c8bb-40eb-ba16-0f937cfe48ff tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1444 microversion: 2.1 time: 0.164847 Aug 30 00:03:34.694990 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 568/1123] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:34 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:34.720245 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-2a2545da-b868-4d79-bae2-c7e6f1a3e9a3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:34.721107 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-2a2545da-b868-4d79-bae2-c7e6f1a3e9a3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:34.727994 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2545da-b868-4d79-bae2-c7e6f1a3e9a3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.728836 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2545da-b868-4d79-bae2-c7e6f1a3e9a3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.729281 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2545da-b868-4d79-bae2-c7e6f1a3e9a3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.729968 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2545da-b868-4d79-bae2-c7e6f1a3e9a3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:34.730412 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2545da-b868-4d79-bae2-c7e6f1a3e9a3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:34.730849 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-2a2545da-b868-4d79-bae2-c7e6f1a3e9a3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:34.870071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-2a2545da-b868-4d79-bae2-c7e6f1a3e9a3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:34.878936 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-2a2545da-b868-4d79-bae2-c7e6f1a3e9a3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1444 microversion: 2.1 time: 0.162724 Aug 30 00:03:34.879502 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 556/1124] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:34 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1444 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:35.428821 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-5273c336-9d6d-481b-8a42-4d9eca040f22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:35.429436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-5273c336-9d6d-481b-8a42-4d9eca040f22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:35.435893 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5273c336-9d6d-481b-8a42-4d9eca040f22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:35.436555 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5273c336-9d6d-481b-8a42-4d9eca040f22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:35.437014 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5273c336-9d6d-481b-8a42-4d9eca040f22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:35.437817 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5273c336-9d6d-481b-8a42-4d9eca040f22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:35.438263 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5273c336-9d6d-481b-8a42-4d9eca040f22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:35.438807 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-5273c336-9d6d-481b-8a42-4d9eca040f22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:35.584254 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-5273c336-9d6d-481b-8a42-4d9eca040f22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:35.592326 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-5273c336-9d6d-481b-8a42-4d9eca040f22 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.168070 Aug 30 00:03:35.593544 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 569/1125] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:35 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:03:36.614966 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7c9283eb-1b84-4bc5-b093-eaf6225cd1be tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:36.615558 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7c9283eb-1b84-4bc5-b093-eaf6225cd1be tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:36.622144 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c9283eb-1b84-4bc5-b093-eaf6225cd1be tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:36.622690 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c9283eb-1b84-4bc5-b093-eaf6225cd1be tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:36.623119 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c9283eb-1b84-4bc5-b093-eaf6225cd1be tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:36.623811 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c9283eb-1b84-4bc5-b093-eaf6225cd1be tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:36.624257 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c9283eb-1b84-4bc5-b093-eaf6225cd1be tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:36.624668 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7c9283eb-1b84-4bc5-b093-eaf6225cd1be tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:36.771928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7c9283eb-1b84-4bc5-b093-eaf6225cd1be tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:36.779915 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7c9283eb-1b84-4bc5-b093-eaf6225cd1be tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.168814 Aug 30 00:03:36.780483 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 557/1126] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:36 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:36.859811 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-71e6a538-bf22-4012-bf0f-21526da04803 req-7b9e882f-5073-4bae-93f7-6323143025d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4f99d9-6f44-41d0-ab65-7464370d9d52", "tag": "d8e2f48a-54fa-4f95-996f-1ce84820f6ed"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:36.870700 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-71e6a538-bf22-4012-bf0f-21526da04803 req-7b9e882f-5073-4bae-93f7-6323143025d0 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:36.871180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-71e6a538-bf22-4012-bf0f-21526da04803 req-7b9e882f-5073-4bae-93f7-6323143025d0 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:36.871603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-71e6a538-bf22-4012-bf0f-21526da04803 req-7b9e882f-5073-4bae-93f7-6323143025d0 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:36.884562 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-71e6a538-bf22-4012-bf0f-21526da04803 req-7b9e882f-5073-4bae-93f7-6323143025d0 service nova] Creating event network-changed:d8e2f48a-54fa-4f95-996f-1ce84820f6ed for instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 on hv-cinder-85427 Aug 30 00:03:36.889513 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-71e6a538-bf22-4012-bf0f-21526da04803 req-7b9e882f-5073-4bae-93f7-6323143025d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033694 Aug 30 00:03:36.890263 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 570/1127] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:03:37.801315 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7fd6b354-938f-4d03-87ff-75c94876ac9a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:37.802046 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7fd6b354-938f-4d03-87ff-75c94876ac9a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:37.804421 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:37.806761 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell0:SELECT=6 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:37.811973 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fd6b354-938f-4d03-87ff-75c94876ac9a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:37.817914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fd6b354-938f-4d03-87ff-75c94876ac9a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:37.817914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fd6b354-938f-4d03-87ff-75c94876ac9a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:37.817914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fd6b354-938f-4d03-87ff-75c94876ac9a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:37.817914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fd6b354-938f-4d03-87ff-75c94876ac9a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:37.818324 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7fd6b354-938f-4d03-87ff-75c94876ac9a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:37.949850 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7fd6b354-938f-4d03-87ff-75c94876ac9a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:37.959062 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7fd6b354-938f-4d03-87ff-75c94876ac9a tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.161714 Aug 30 00:03:37.959632 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 558/1128] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:37 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:38.978290 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell0:SELECT=2 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:38.982713 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d56891dc-3198-4d94-b333-7f47196ebaac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:38.983418 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d56891dc-3198-4d94-b333-7f47196ebaac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:38.990225 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d56891dc-3198-4d94-b333-7f47196ebaac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.990736 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d56891dc-3198-4d94-b333-7f47196ebaac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.991169 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d56891dc-3198-4d94-b333-7f47196ebaac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:38.991982 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d56891dc-3198-4d94-b333-7f47196ebaac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:38.992703 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d56891dc-3198-4d94-b333-7f47196ebaac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:38.993129 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d56891dc-3198-4d94-b333-7f47196ebaac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:39.153696 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-d56891dc-3198-4d94-b333-7f47196ebaac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:39.163022 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d56891dc-3198-4d94-b333-7f47196ebaac tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.186193 Aug 30 00:03:39.166924 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 571/1129] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:38 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:40.183902 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cc39c6bf-f7de-4dc3-a31f-5cb338de5047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:40.184500 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-cc39c6bf-f7de-4dc3-a31f-5cb338de5047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:40.191239 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc39c6bf-f7de-4dc3-a31f-5cb338de5047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:40.191714 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc39c6bf-f7de-4dc3-a31f-5cb338de5047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:40.192143 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc39c6bf-f7de-4dc3-a31f-5cb338de5047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:40.192830 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc39c6bf-f7de-4dc3-a31f-5cb338de5047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:40.193273 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc39c6bf-f7de-4dc3-a31f-5cb338de5047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:40.193684 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc39c6bf-f7de-4dc3-a31f-5cb338de5047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:40.329181 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-cc39c6bf-f7de-4dc3-a31f-5cb338de5047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:40.337530 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-cc39c6bf-f7de-4dc3-a31f-5cb338de5047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.157470 Aug 30 00:03:40.338085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 559/1130] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:40 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:41.358597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-3e328839-95f8-4bfd-a128-180f25c5bac0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:41.359211 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-3e328839-95f8-4bfd-a128-180f25c5bac0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:41.365569 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e328839-95f8-4bfd-a128-180f25c5bac0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:41.366053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e328839-95f8-4bfd-a128-180f25c5bac0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:41.366518 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e328839-95f8-4bfd-a128-180f25c5bac0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:41.367210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e328839-95f8-4bfd-a128-180f25c5bac0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:41.367660 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e328839-95f8-4bfd-a128-180f25c5bac0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:41.368090 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-3e328839-95f8-4bfd-a128-180f25c5bac0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:41.502546 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-3e328839-95f8-4bfd-a128-180f25c5bac0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:41.507584 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-3e328839-95f8-4bfd-a128-180f25c5bac0 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.153104 Aug 30 00:03:41.508197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 572/1131] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:41 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:42.528988 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-bee3a1d8-9467-4749-bda1-54540f3d9e29 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:42.529568 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-bee3a1d8-9467-4749-bda1-54540f3d9e29 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:42.536400 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bee3a1d8-9467-4749-bda1-54540f3d9e29 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:42.536871 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bee3a1d8-9467-4749-bda1-54540f3d9e29 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:42.537396 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bee3a1d8-9467-4749-bda1-54540f3d9e29 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:42.537976 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bee3a1d8-9467-4749-bda1-54540f3d9e29 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:42.538436 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bee3a1d8-9467-4749-bda1-54540f3d9e29 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:42.538858 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-bee3a1d8-9467-4749-bda1-54540f3d9e29 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:42.681654 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-bee3a1d8-9467-4749-bda1-54540f3d9e29 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:42.690413 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-bee3a1d8-9467-4749-bda1-54540f3d9e29 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.164697 Aug 30 00:03:42.691108 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 560/1132] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:42 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:43.712720 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c5938913-49f2-4618-90d2-b4107fdee203 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:43.713314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c5938913-49f2-4618-90d2-b4107fdee203 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:43.715686 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:43.720480 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c5938913-49f2-4618-90d2-b4107fdee203 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:43.720963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c5938913-49f2-4618-90d2-b4107fdee203 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:43.722116 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c5938913-49f2-4618-90d2-b4107fdee203 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:43.722797 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c5938913-49f2-4618-90d2-b4107fdee203 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:43.723252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c5938913-49f2-4618-90d2-b4107fdee203 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:43.723677 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c5938913-49f2-4618-90d2-b4107fdee203 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:43.726260 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=97 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:43.861659 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c5938913-49f2-4618-90d2-b4107fdee203 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:43.869980 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c5938913-49f2-4618-90d2-b4107fdee203 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.161207 Aug 30 00:03:43.870564 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 573/1133] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:43 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:44.514747 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-cac1366e-0400-4853-96b5-1a1cb4d17819 req-a22388fb-026c-4e1b-b16e-5d4216749a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79c5170-5e23-402b-9da6-706f8fad5507", "name": "network-vif-plugged", "status": "completed", "tag": "5f9f8076-cb47-4718-8b08-9ef61c33bd46"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:44.526159 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-cac1366e-0400-4853-96b5-1a1cb4d17819 req-a22388fb-026c-4e1b-b16e-5d4216749a33 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:44.526671 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-cac1366e-0400-4853-96b5-1a1cb4d17819 req-a22388fb-026c-4e1b-b16e-5d4216749a33 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:44.527099 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-cac1366e-0400-4853-96b5-1a1cb4d17819 req-a22388fb-026c-4e1b-b16e-5d4216749a33 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:44.539029 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-cac1366e-0400-4853-96b5-1a1cb4d17819 req-a22388fb-026c-4e1b-b16e-5d4216749a33 service nova] Creating event network-vif-plugged:5f9f8076-cb47-4718-8b08-9ef61c33bd46 for instance b79c5170-5e23-402b-9da6-706f8fad5507 on hv-cinder-85427 Aug 30 00:03:44.544135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-cac1366e-0400-4853-96b5-1a1cb4d17819 req-a22388fb-026c-4e1b-b16e-5d4216749a33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033058 Aug 30 00:03:44.544758 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 561/1134] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:03:44.891026 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7410278d-a6fb-4222-8ff8-c401bbd4479f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:44.891623 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7410278d-a6fb-4222-8ff8-c401bbd4479f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:44.899100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7410278d-a6fb-4222-8ff8-c401bbd4479f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:44.899582 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7410278d-a6fb-4222-8ff8-c401bbd4479f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:44.900006 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7410278d-a6fb-4222-8ff8-c401bbd4479f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:44.900692 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7410278d-a6fb-4222-8ff8-c401bbd4479f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:44.901136 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7410278d-a6fb-4222-8ff8-c401bbd4479f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:44.901556 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7410278d-a6fb-4222-8ff8-c401bbd4479f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:45.051479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:03:45.051705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Tue Aug 30 00:03:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 (ip 10.222.0.58) !!! Aug 30 00:03:45.075033 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7410278d-a6fb-4222-8ff8-c401bbd4479f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:45.083899 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7410278d-a6fb-4222-8ff8-c401bbd4479f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.196775 Aug 30 00:03:45.084479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 574/1135] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:44 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:46.105797 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-daad12ca-b1ad-4696-8a71-93afc6dacf60 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:46.106563 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-daad12ca-b1ad-4696-8a71-93afc6dacf60 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:46.113753 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-daad12ca-b1ad-4696-8a71-93afc6dacf60 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.114230 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-daad12ca-b1ad-4696-8a71-93afc6dacf60 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.114695 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-daad12ca-b1ad-4696-8a71-93afc6dacf60 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.115385 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-daad12ca-b1ad-4696-8a71-93afc6dacf60 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:46.115831 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-daad12ca-b1ad-4696-8a71-93afc6dacf60 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:46.116251 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-daad12ca-b1ad-4696-8a71-93afc6dacf60 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:46.118907 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=99 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:46.253741 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-daad12ca-b1ad-4696-8a71-93afc6dacf60 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:46.262962 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-daad12ca-b1ad-4696-8a71-93afc6dacf60 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1264 microversion: 2.1 time: 0.161937 Aug 30 00:03:46.263528 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 562/1136] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:46 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:47.284192 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a9cd4d11-1988-419b-b5db-50469b67f633 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:47.284774 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a9cd4d11-1988-419b-b5db-50469b67f633 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:47.292434 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9cd4d11-1988-419b-b5db-50469b67f633 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:47.292908 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9cd4d11-1988-419b-b5db-50469b67f633 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:47.295309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9cd4d11-1988-419b-b5db-50469b67f633 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:47.295309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9cd4d11-1988-419b-b5db-50469b67f633 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:47.295309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9cd4d11-1988-419b-b5db-50469b67f633 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:47.295309 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a9cd4d11-1988-419b-b5db-50469b67f633 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:47.433364 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a9cd4d11-1988-419b-b5db-50469b67f633 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:47.441198 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a9cd4d11-1988-419b-b5db-50469b67f633 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1451 microversion: 2.1 time: 0.161006 Aug 30 00:03:47.441762 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 575/1137] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:47 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:47.466413 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-223dbaf5-3bd1-4961-adcf-4850b61dd1fa tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:03:47.467035 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-223dbaf5-3bd1-4961-adcf-4850b61dd1fa tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:03:47.469601 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:47.474890 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-223dbaf5-3bd1-4961-adcf-4850b61dd1fa tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:47.475363 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-223dbaf5-3bd1-4961-adcf-4850b61dd1fa tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:47.475788 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-223dbaf5-3bd1-4961-adcf-4850b61dd1fa tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:47.476465 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-223dbaf5-3bd1-4961-adcf-4850b61dd1fa tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:47.476905 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-223dbaf5-3bd1-4961-adcf-4850b61dd1fa tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:47.477385 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-223dbaf5-3bd1-4961-adcf-4850b61dd1fa tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:47.610957 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-223dbaf5-3bd1-4961-adcf-4850b61dd1fa tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:03:47.619200 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-223dbaf5-3bd1-4961-adcf-4850b61dd1fa tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1451 microversion: 2.1 time: 0.156911 Aug 30 00:03:47.619771 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 563/1138] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:03:47 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:49.669646 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-9aaa537c-f3de-459f-b263-943d555beec3 req-5d3577de-a9f4-4869-a0a4-e3156d469948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79c5170-5e23-402b-9da6-706f8fad5507", "tag": "5f9f8076-cb47-4718-8b08-9ef61c33bd46"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:03:49.680040 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-9aaa537c-f3de-459f-b263-943d555beec3 req-5d3577de-a9f4-4869-a0a4-e3156d469948 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:03:49.684279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-9aaa537c-f3de-459f-b263-943d555beec3 req-5d3577de-a9f4-4869-a0a4-e3156d469948 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:03:49.684279 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-9aaa537c-f3de-459f-b263-943d555beec3 req-5d3577de-a9f4-4869-a0a4-e3156d469948 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:03:49.693131 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-9aaa537c-f3de-459f-b263-943d555beec3 req-5d3577de-a9f4-4869-a0a4-e3156d469948 service nova] Creating event network-changed:5f9f8076-cb47-4718-8b08-9ef61c33bd46 for instance b79c5170-5e23-402b-9da6-706f8fad5507 on hv-cinder-85427 Aug 30 00:03:49.698848 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-9aaa537c-f3de-459f-b263-943d555beec3 req-5d3577de-a9f4-4869-a0a4-e3156d469948 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089694 Aug 30 00:03:49.699638 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 576/1139] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:29.727181 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=11 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:29.728286 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:05:29.728449 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Tue Aug 30 00:05:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 (ip 10.222.0.58) !!! Aug 30 00:05:29.734071 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-27a4bb94-334c-4a94-b9fd-9eaedca8f047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:29.738479 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-2b975e2e-caa6-4ad8-b56f-7f219f8a02a5 req-0b5f1c73-d8e7-4553-81f7-dc0ea9fca6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b79c5170-5e23-402b-9da6-706f8fad5507", "tag": "5f9f8076-cb47-4718-8b08-9ef61c33bd46"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:29.739017 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-27a4bb94-334c-4a94-b9fd-9eaedca8f047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:29.740564 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=7 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:29.741348 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=19 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:29.742237 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 00:05:29.742400 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Tue Aug 30 00:05:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Aug 30 00:05:29.743993 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27a4bb94-334c-4a94-b9fd-9eaedca8f047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:29.743993 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27a4bb94-334c-4a94-b9fd-9eaedca8f047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:29.743993 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27a4bb94-334c-4a94-b9fd-9eaedca8f047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:29.744318 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27a4bb94-334c-4a94-b9fd-9eaedca8f047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:29.744776 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27a4bb94-334c-4a94-b9fd-9eaedca8f047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:29.745206 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27a4bb94-334c-4a94-b9fd-9eaedca8f047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:29.751314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2b975e2e-caa6-4ad8-b56f-7f219f8a02a5 req-0b5f1c73-d8e7-4553-81f7-dc0ea9fca6b7 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:29.751314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2b975e2e-caa6-4ad8-b56f-7f219f8a02a5 req-0b5f1c73-d8e7-4553-81f7-dc0ea9fca6b7 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:29.751703 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-2b975e2e-caa6-4ad8-b56f-7f219f8a02a5 req-0b5f1c73-d8e7-4553-81f7-dc0ea9fca6b7 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:29.765992 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-2b975e2e-caa6-4ad8-b56f-7f219f8a02a5 req-0b5f1c73-d8e7-4553-81f7-dc0ea9fca6b7 service nova] Creating event network-changed:5f9f8076-cb47-4718-8b08-9ef61c33bd46 for instance b79c5170-5e23-402b-9da6-706f8fad5507 on hv-cinder-85427 Aug 30 00:05:29.771194 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-2b975e2e-caa6-4ad8-b56f-7f219f8a02a5 req-0b5f1c73-d8e7-4553-81f7-dc0ea9fca6b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042446 Aug 30 00:05:29.772115 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 577/1140] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:29.776589 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-27a4bb94-334c-4a94-b9fd-9eaedca8f047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Going to try to terminate instance {{(pid=127706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:05:30.067220 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-27a4bb94-334c-4a94-b9fd-9eaedca8f047 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 204 len: 0 microversion: 2.1 time: 0.341558 Aug 30 00:05:30.068524 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 564/1141] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 30 00:05:29 2022] DELETE /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:05:30.085299 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-0ad52f52-1e1a-4f8b-894e-64417d9d74af tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:30.086991 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-0ad52f52-1e1a-4f8b-894e-64417d9d74af tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:30.095330 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ad52f52-1e1a-4f8b-894e-64417d9d74af tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:30.095819 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ad52f52-1e1a-4f8b-894e-64417d9d74af tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:30.096251 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ad52f52-1e1a-4f8b-894e-64417d9d74af tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:30.097021 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ad52f52-1e1a-4f8b-894e-64417d9d74af tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:30.097468 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ad52f52-1e1a-4f8b-894e-64417d9d74af tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:30.097888 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-0ad52f52-1e1a-4f8b-894e-64417d9d74af tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:30.234640 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-0ad52f52-1e1a-4f8b-894e-64417d9d74af tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:30.243560 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-0ad52f52-1e1a-4f8b-894e-64417d9d74af tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1576 microversion: 2.1 time: 0.168324 Aug 30 00:05:30.244137 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 578/1142] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:30 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:31.266440 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d473d737-b55f-46a5-a03b-be60e9b98161 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:31.267056 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d473d737-b55f-46a5-a03b-be60e9b98161 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:31.273914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d473d737-b55f-46a5-a03b-be60e9b98161 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:31.274742 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d473d737-b55f-46a5-a03b-be60e9b98161 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:31.275177 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d473d737-b55f-46a5-a03b-be60e9b98161 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:31.275916 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d473d737-b55f-46a5-a03b-be60e9b98161 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:31.276318 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d473d737-b55f-46a5-a03b-be60e9b98161 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:31.276735 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d473d737-b55f-46a5-a03b-be60e9b98161 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:31.478446 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d473d737-b55f-46a5-a03b-be60e9b98161 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:31.486767 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d473d737-b55f-46a5-a03b-be60e9b98161 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1576 microversion: 2.1 time: 0.225262 Aug 30 00:05:31.487616 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 565/1143] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:31 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1576 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:32.478201 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-bfb7d7c8-acf1-40b8-b866-82e2303fb373 req-038db4d7-1c94-4658-a4f7-7908c2ff4ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b79c5170-5e23-402b-9da6-706f8fad5507", "name": "network-vif-deleted", "tag": "5f9f8076-cb47-4718-8b08-9ef61c33bd46"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:32.488942 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-bfb7d7c8-acf1-40b8-b866-82e2303fb373 req-038db4d7-1c94-4658-a4f7-7908c2ff4ffd service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:32.491064 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-bfb7d7c8-acf1-40b8-b866-82e2303fb373 req-038db4d7-1c94-4658-a4f7-7908c2ff4ffd service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:32.491064 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-bfb7d7c8-acf1-40b8-b866-82e2303fb373 req-038db4d7-1c94-4658-a4f7-7908c2ff4ffd service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:32.501608 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-bfb7d7c8-acf1-40b8-b866-82e2303fb373 req-038db4d7-1c94-4658-a4f7-7908c2ff4ffd service nova] Creating event network-vif-deleted:5f9f8076-cb47-4718-8b08-9ef61c33bd46 for instance b79c5170-5e23-402b-9da6-706f8fad5507 on hv-cinder-85427 Aug 30 00:05:32.506553 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-bfb7d7c8-acf1-40b8-b866-82e2303fb373 req-038db4d7-1c94-4658-a4f7-7908c2ff4ffd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032228 Aug 30 00:05:32.507132 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 579/1144] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:32.509277 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-35b14c07-3316-463e-b101-31f88694f20f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:32.509974 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-35b14c07-3316-463e-b101-31f88694f20f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:32.517026 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35b14c07-3316-463e-b101-31f88694f20f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:32.519864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35b14c07-3316-463e-b101-31f88694f20f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:32.519864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35b14c07-3316-463e-b101-31f88694f20f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:32.519864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35b14c07-3316-463e-b101-31f88694f20f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:32.519864 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35b14c07-3316-463e-b101-31f88694f20f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:32.520277 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-35b14c07-3316-463e-b101-31f88694f20f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:32.582715 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-35b14c07-3316-463e-b101-31f88694f20f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:32.590472 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-35b14c07-3316-463e-b101-31f88694f20f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1389 microversion: 2.1 time: 0.085308 Aug 30 00:05:32.591038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 566/1145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:32 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:33.614023 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:33.614751 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:33.620990 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:33.621476 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:33.621915 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:33.622644 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:33.623091 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:33.623513 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:33.655684 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:33.656180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:33.656611 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:33.657048 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lazy-loading 'fault' on Instance uuid b79c5170-5e23-402b-9da6-706f8fad5507 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:05:33.701926 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:33.709813 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-c86f2006-6729-4671-93e0-67f00dcc735f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 200 len: 1228 microversion: 2.1 time: 0.101418 Aug 30 00:05:33.710393 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 580/1146] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:33 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 1228 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:34.731767 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:34.732367 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: b79c5170-5e23-402b-9da6-706f8fad5507] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:34.739400 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:34.739877 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:34.740314 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:34.740999 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:34.741444 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:34.741870 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:34.755450 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] HTTP exception thrown: Instance b79c5170-5e23-402b-9da6-706f8fad5507 could not be found. Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Request method failure captured: Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 HTTP/1.1 Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVJ_fB-DF2fs89Mj2dTal5ah3NclNk4ZyCxlz79w60JXYS95Tg41WkW-ILRVFW-I3lmf3Q48alB6OVFFmFyBESyeRovylc0yKoFR2laEdBeioH972qu_mS3mMTc-sb-OyDxnYONEe1WKYgIoHkt4fbhM-pXBoYAR5p0-2o2PHLkoLR8 Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: c78ff4cbc0994af8855b1ac67cb281fe Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 30 00:05:34.757093 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c78ff4cbc0994af8855b1ac67cb281fe", "adminURL": "http://10.222.0.58:8080"}]}] Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: c78ff4cbc0994af8855b1ac67cb281fe Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-TestVolumeBootPattern-1495322451-project Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 1e63436f5691431d802706a8d5a6df7f Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-TestVolumeBootPattern-1495322451-project Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance b79c5170-5e23-402b-9da6-706f8fad5507 could not be found. Aug 30 00:05:34.758815 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': 'b79c5170-5e23-402b-9da6-706f8fad5507'} Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b79c5170-5e23-402b-9da6-706f8fad5507 could not be found. Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:05:34.759718 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b79c5170-5e23-402b-9da6-706f8fad5507 could not be found. Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b79c5170-5e23-402b-9da6-706f8fad5507 could not be found. Aug 30 00:05:34.761429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:05:34.762969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Returning 404 to user: Instance b79c5170-5e23-402b-9da6-706f8fad5507 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:05:34.762969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-34ec3e33-2486-4484-8895-3bbf3158dfad tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507" status: 404 len: 111 microversion: 2.1 time: 0.030716 Aug 30 00:05:34.762969 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 567/1147] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:34 2022] GET /compute/v2.1/servers/b79c5170-5e23-402b-9da6-706f8fad5507 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:05:35.600131 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-d607baf0-d739-46e3-a7ef-8d24dd29024f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:35.600735 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-d607baf0-d739-46e3-a7ef-8d24dd29024f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:35.607078 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d607baf0-d739-46e3-a7ef-8d24dd29024f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:35.607556 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d607baf0-d739-46e3-a7ef-8d24dd29024f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:35.608066 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d607baf0-d739-46e3-a7ef-8d24dd29024f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:35.609588 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d607baf0-d739-46e3-a7ef-8d24dd29024f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:35.610113 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d607baf0-d739-46e3-a7ef-8d24dd29024f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:35.610568 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-d607baf0-d739-46e3-a7ef-8d24dd29024f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:35.636296 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-d607baf0-d739-46e3-a7ef-8d24dd29024f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lazy-loading 'flavor' on Instance uuid 1b4f99d9-6f44-41d0-ab65-7464370d9d52 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:05:35.899272 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-d607baf0-d739-46e3-a7ef-8d24dd29024f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "POST /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52/action" status: 202 len: 0 microversion: 2.1 time: 0.302821 Aug 30 00:05:35.899770 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 581/1148] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 30 00:05:35 2022] POST /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:05:35.909321 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-cc9f84d7-94e9-409d-a95c-ce5f46746a82 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:35.910294 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-cc9f84d7-94e9-409d-a95c-ce5f46746a82 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:35.916802 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc9f84d7-94e9-409d-a95c-ce5f46746a82 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:35.917276 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc9f84d7-94e9-409d-a95c-ce5f46746a82 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:35.917703 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc9f84d7-94e9-409d-a95c-ce5f46746a82 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:35.918399 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc9f84d7-94e9-409d-a95c-ce5f46746a82 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:35.918865 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc9f84d7-94e9-409d-a95c-ce5f46746a82 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:35.919290 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-cc9f84d7-94e9-409d-a95c-ce5f46746a82 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:36.065123 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-cc9f84d7-94e9-409d-a95c-ce5f46746a82 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:36.073950 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-cc9f84d7-94e9-409d-a95c-ce5f46746a82 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.169272 Aug 30 00:05:36.074550 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 568/1149] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:35 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:37.096725 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-db1d5b9b-5af4-4b99-b1de-a6bf73dbb720 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:37.097411 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-db1d5b9b-5af4-4b99-b1de-a6bf73dbb720 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:37.103590 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-db1d5b9b-5af4-4b99-b1de-a6bf73dbb720 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:37.104063 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-db1d5b9b-5af4-4b99-b1de-a6bf73dbb720 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:37.104487 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-db1d5b9b-5af4-4b99-b1de-a6bf73dbb720 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:37.105165 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-db1d5b9b-5af4-4b99-b1de-a6bf73dbb720 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:37.105603 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-db1d5b9b-5af4-4b99-b1de-a6bf73dbb720 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:37.106017 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-db1d5b9b-5af4-4b99-b1de-a6bf73dbb720 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:37.247636 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-db1d5b9b-5af4-4b99-b1de-a6bf73dbb720 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:37.256785 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-db1d5b9b-5af4-4b99-b1de-a6bf73dbb720 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.165298 Aug 30 00:05:37.259180 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 582/1150] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:37 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:38.169271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-18d15300-699e-4e30-9a36-c0f61f239646 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:38.169271 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-18d15300-699e-4e30-9a36-c0f61f239646 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:38.176782 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18d15300-699e-4e30-9a36-c0f61f239646 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.177273 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18d15300-699e-4e30-9a36-c0f61f239646 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.177707 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18d15300-699e-4e30-9a36-c0f61f239646 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.178415 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18d15300-699e-4e30-9a36-c0f61f239646 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.178901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18d15300-699e-4e30-9a36-c0f61f239646 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.179636 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-18d15300-699e-4e30-9a36-c0f61f239646 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.209530 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-18d15300-699e-4e30-9a36-c0f61f239646 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Going to try to terminate instance {{(pid=127706) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:05:38.236325 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-45612ddf-7cdf-4d12-86b7-96e3f1f601fd req-8321543d-9425-4582-b909-b9e302f1053c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f051f8-b22f-462d-9638-085850018918", "tag": "a37b351a-0c4d-40e1-805b-bd45bbb90500"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:38.246786 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-45612ddf-7cdf-4d12-86b7-96e3f1f601fd req-8321543d-9425-4582-b909-b9e302f1053c service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.247412 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-45612ddf-7cdf-4d12-86b7-96e3f1f601fd req-8321543d-9425-4582-b909-b9e302f1053c service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.248092 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-45612ddf-7cdf-4d12-86b7-96e3f1f601fd req-8321543d-9425-4582-b909-b9e302f1053c service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.276762 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-45612ddf-7cdf-4d12-86b7-96e3f1f601fd req-8321543d-9425-4582-b909-b9e302f1053c service nova] Creating event network-changed:a37b351a-0c4d-40e1-805b-bd45bbb90500 for instance c8f051f8-b22f-462d-9638-085850018918 on hv-cinder-85427 Aug 30 00:05:38.282927 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-45612ddf-7cdf-4d12-86b7-96e3f1f601fd req-8321543d-9425-4582-b909-b9e302f1053c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116564 Aug 30 00:05:38.283395 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 583/1151] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:38.288440 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-bf4ebffa-c0b0-469a-b552-3e9752e30040 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:38.289142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-bf4ebffa-c0b0-469a-b552-3e9752e30040 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:38.295621 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bf4ebffa-c0b0-469a-b552-3e9752e30040 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.296141 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bf4ebffa-c0b0-469a-b552-3e9752e30040 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.296586 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bf4ebffa-c0b0-469a-b552-3e9752e30040 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.297292 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bf4ebffa-c0b0-469a-b552-3e9752e30040 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.297742 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bf4ebffa-c0b0-469a-b552-3e9752e30040 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.298168 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-bf4ebffa-c0b0-469a-b552-3e9752e30040 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.521764 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-18d15300-699e-4e30-9a36-c0f61f239646 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 204 len: 0 microversion: 2.1 time: 0.357481 Aug 30 00:05:38.522905 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 569/1152] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 30 00:05:38 2022] DELETE /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:05:38.534901 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-75fd5e61-4755-4078-a829-4b7215034373 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:38.535927 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-75fd5e61-4755-4078-a829-4b7215034373 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:38.542706 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75fd5e61-4755-4078-a829-4b7215034373 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.543193 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75fd5e61-4755-4078-a829-4b7215034373 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.543854 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75fd5e61-4755-4078-a829-4b7215034373 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.544899 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75fd5e61-4755-4078-a829-4b7215034373 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:38.545353 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75fd5e61-4755-4078-a829-4b7215034373 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:38.546298 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-75fd5e61-4755-4078-a829-4b7215034373 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:38.556860 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-bf4ebffa-c0b0-469a-b552-3e9752e30040 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:38.568121 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-bf4ebffa-c0b0-469a-b552-3e9752e30040 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.283489 Aug 30 00:05:38.570277 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 584/1153] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:38 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:38.688597 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-75fd5e61-4755-4078-a829-4b7215034373 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:38.696604 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-75fd5e61-4755-4078-a829-4b7215034373 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1579 microversion: 2.1 time: 0.168266 Aug 30 00:05:38.697175 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 570/1154] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:38 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:39.590855 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7512e17e-de7b-4266-9837-17d31eed7cc0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:39.591427 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7512e17e-de7b-4266-9837-17d31eed7cc0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:39.599210 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7512e17e-de7b-4266-9837-17d31eed7cc0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:39.599690 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7512e17e-de7b-4266-9837-17d31eed7cc0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:39.600120 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7512e17e-de7b-4266-9837-17d31eed7cc0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:39.600821 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7512e17e-de7b-4266-9837-17d31eed7cc0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:39.601293 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7512e17e-de7b-4266-9837-17d31eed7cc0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:39.601703 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7512e17e-de7b-4266-9837-17d31eed7cc0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:39.720202 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-7ba818ca-0f67-42eb-83ea-f6edaebbadb6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:39.721730 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-7ba818ca-0f67-42eb-83ea-f6edaebbadb6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:39.730154 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ba818ca-0f67-42eb-83ea-f6edaebbadb6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:39.731036 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ba818ca-0f67-42eb-83ea-f6edaebbadb6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:39.731477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ba818ca-0f67-42eb-83ea-f6edaebbadb6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:39.732187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ba818ca-0f67-42eb-83ea-f6edaebbadb6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:39.732635 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ba818ca-0f67-42eb-83ea-f6edaebbadb6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:39.733057 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-7ba818ca-0f67-42eb-83ea-f6edaebbadb6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:39.861443 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7512e17e-de7b-4266-9837-17d31eed7cc0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:39.872287 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7512e17e-de7b-4266-9837-17d31eed7cc0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.285086 Aug 30 00:05:39.886685 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 585/1155] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:39 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:39.948899 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-7ba818ca-0f67-42eb-83ea-f6edaebbadb6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:39.957500 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-7ba818ca-0f67-42eb-83ea-f6edaebbadb6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1579 microversion: 2.1 time: 0.242153 Aug 30 00:05:39.958085 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 571/1156] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:39 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1579 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:40.824478 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-f1ca8e25-ddf4-4abb-8ec2-c3c6ad4b6092 req-c75d792c-90b3-4e12-bcae-e2af7e51fda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f051f8-b22f-462d-9638-085850018918", "name": "network-vif-deleted", "tag": "a37b351a-0c4d-40e1-805b-bd45bbb90500"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:40.834832 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-f1ca8e25-ddf4-4abb-8ec2-c3c6ad4b6092 req-c75d792c-90b3-4e12-bcae-e2af7e51fda7 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:40.836361 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-f1ca8e25-ddf4-4abb-8ec2-c3c6ad4b6092 req-c75d792c-90b3-4e12-bcae-e2af7e51fda7 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:40.836361 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-f1ca8e25-ddf4-4abb-8ec2-c3c6ad4b6092 req-c75d792c-90b3-4e12-bcae-e2af7e51fda7 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:40.846828 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-f1ca8e25-ddf4-4abb-8ec2-c3c6ad4b6092 req-c75d792c-90b3-4e12-bcae-e2af7e51fda7 service nova] Creating event network-vif-deleted:a37b351a-0c4d-40e1-805b-bd45bbb90500 for instance c8f051f8-b22f-462d-9638-085850018918 on hv-cinder-85427 Aug 30 00:05:40.851586 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-f1ca8e25-ddf4-4abb-8ec2-c3c6ad4b6092 req-c75d792c-90b3-4e12-bcae-e2af7e51fda7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030852 Aug 30 00:05:40.852166 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 586/1157] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:05:40.895231 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-c80efaea-579e-45be-95fa-f76b2d90fc29 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:40.895871 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-c80efaea-579e-45be-95fa-f76b2d90fc29 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:40.902471 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c80efaea-579e-45be-95fa-f76b2d90fc29 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:40.902952 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c80efaea-579e-45be-95fa-f76b2d90fc29 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:40.903380 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c80efaea-579e-45be-95fa-f76b2d90fc29 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:40.904075 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c80efaea-579e-45be-95fa-f76b2d90fc29 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:40.904521 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c80efaea-579e-45be-95fa-f76b2d90fc29 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:40.904947 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-c80efaea-579e-45be-95fa-f76b2d90fc29 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:40.981715 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4b92d40a-5616-43fd-91e6-ea6e1fe38f2f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:40.982514 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4b92d40a-5616-43fd-91e6-ea6e1fe38f2f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:40.990721 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b92d40a-5616-43fd-91e6-ea6e1fe38f2f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:40.990849 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b92d40a-5616-43fd-91e6-ea6e1fe38f2f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:40.991471 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b92d40a-5616-43fd-91e6-ea6e1fe38f2f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:40.991869 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b92d40a-5616-43fd-91e6-ea6e1fe38f2f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:40.992317 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b92d40a-5616-43fd-91e6-ea6e1fe38f2f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:40.992734 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b92d40a-5616-43fd-91e6-ea6e1fe38f2f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:41.057960 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-c80efaea-579e-45be-95fa-f76b2d90fc29 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:41.066661 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-c80efaea-579e-45be-95fa-f76b2d90fc29 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.175230 Aug 30 00:05:41.067248 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 572/1158] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:40 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:41.074272 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4b92d40a-5616-43fd-91e6-ea6e1fe38f2f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e63436f5691431d802706a8d5a6df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78ff4cbc0994af8855b1ac67cb281fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:41.083068 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4b92d40a-5616-43fd-91e6-ea6e1fe38f2f tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 200 len: 1225 microversion: 2.1 time: 0.106062 Aug 30 00:05:41.083642 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 587/1159] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:40 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:42.089537 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-1812be00-9cd7-4959-819e-fdedd99403b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:42.090141 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-1812be00-9cd7-4959-819e-fdedd99403b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:42.097420 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1812be00-9cd7-4959-819e-fdedd99403b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.097891 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1812be00-9cd7-4959-819e-fdedd99403b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.098391 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1812be00-9cd7-4959-819e-fdedd99403b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.099038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1812be00-9cd7-4959-819e-fdedd99403b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.099482 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1812be00-9cd7-4959-819e-fdedd99403b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.099974 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-1812be00-9cd7-4959-819e-fdedd99403b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.105592 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:42.111100 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: c8f051f8-b22f-462d-9638-085850018918] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:42.114466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.115013 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.115447 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.116139 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.116597 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.117170 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.145458 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] HTTP exception thrown: Instance c8f051f8-b22f-462d-9638-085850018918 could not be found. Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Request method failure captured: Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 HTTP/1.1 Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVJ_fB-DF2fs89Mj2dTal5ah3NclNk4ZyCxlz79w60JXYS95Tg41WkW-ILRVFW-I3lmf3Q48alB6OVFFmFyBESyeRovylc0yKoFR2laEdBeioH972qu_mS3mMTc-sb-OyDxnYONEe1WKYgIoHkt4fbhM-pXBoYAR5p0-2o2PHLkoLR8 Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: c78ff4cbc0994af8855b1ac67cb281fe Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 30 00:05:42.147274 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c78ff4cbc0994af8855b1ac67cb281fe", "adminURL": "http://10.222.0.58:8080"}]}] Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: c78ff4cbc0994af8855b1ac67cb281fe Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-TestVolumeBootPattern-1495322451-project Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 1e63436f5691431d802706a8d5a6df7f Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-TestVolumeBootPattern-1495322451-project Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance c8f051f8-b22f-462d-9638-085850018918 could not be found. Aug 30 00:05:42.149107 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': 'c8f051f8-b22f-462d-9638-085850018918'} Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f051f8-b22f-462d-9638-085850018918 could not be found. Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:05:42.150229 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f051f8-b22f-462d-9638-085850018918 could not be found. Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f051f8-b22f-462d-9638-085850018918 could not be found. Aug 30 00:05:42.152484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.154930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Returning 404 to user: Instance c8f051f8-b22f-462d-9638-085850018918 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:05:42.154930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-fd14aeef-c754-4f72-adc7-bcc58318f728 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918" status: 404 len: 111 microversion: 2.1 time: 0.047570 Aug 30 00:05:42.154930 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 588/1160] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:42 2022] GET /compute/v2.1/servers/c8f051f8-b22f-462d-9638-085850018918 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:05:42.244672 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-1812be00-9cd7-4959-819e-fdedd99403b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:42.253447 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-1812be00-9cd7-4959-819e-fdedd99403b8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.167809 Aug 30 00:05:42.254722 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 573/1161] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:42 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:42.903864 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:42.904352 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:42.910745 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.911224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.911649 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.912338 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.912779 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.913197 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.927656 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.wsgi [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] HTTP exception thrown: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Request method failure captured: Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: request: DELETE /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 HTTP/1.1 Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept: application/json Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Accept-Encoding: identity Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Connection: close Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Length: 0 Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Content-Type: application/json Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Host: 10.222.0.58 Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: Openstack-System-Scope: None Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: User-Agent: python-urllib3/1.26.12 Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Auth-Token: gAAAAABjDVJ_fB-DF2fs89Mj2dTal5ah3NclNk4ZyCxlz79w60JXYS95Tg41WkW-ILRVFW-I3lmf3Q48alB6OVFFmFyBESyeRovylc0yKoFR2laEdBeioH972qu_mS3mMTc-sb-OyDxnYONEe1WKYgIoHkt4fbhM-pXBoYAR5p0-2o2PHLkoLR8 Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Id: None Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Domain-Name: None Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Identity-Status: Confirmed Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Is-Admin-Project: True Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Id: default Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Domain-Name: Default Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Id: c78ff4cbc0994af8855b1ac67cb281fe Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Project-Name: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Role: member,reader Aug 30 00:05:42.929185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Roles: member,reader Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c78ff4cbc0994af8855b1ac67cb281fe", "adminURL": "http://10.222.0.58:8080"}]}] Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Id: c78ff4cbc0994af8855b1ac67cb281fe Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-Tenant-Name: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User: tempest-TestVolumeBootPattern-1495322451-project Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Id: default Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Domain-Name: Default Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Id: 1e63436f5691431d802706a8d5a6df7f Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: X-User-Name: tempest-TestVolumeBootPattern-1495322451-project Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: method: > Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: exception: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:05:42.931178 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: action_args: {'id': '5b660d30-8ce5-48f3-9337-2dbcd3c62e05'} Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:05:42.932240 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:05:42.933759 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.935743 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Returning 404 to user: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. {{(pid=127705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:05:42.935743 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-13b30214-28c7-46fe-a1ed-2e13378a9ac6 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 404 len: 111 microversion: 2.1 time: 0.031451 Aug 30 00:05:42.935743 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 589/1162] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 30 00:05:42 2022] DELETE /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:05:42.940114 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:42.940729 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] [instance: 5b660d30-8ce5-48f3-9337-2dbcd3c62e05] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:42.946726 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.947204 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.947637 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.948327 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:42.948777 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:42.949201 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:42.962875 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] HTTP exception thrown: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Request method failure captured: Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 HTTP/1.1 Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVJ_fB-DF2fs89Mj2dTal5ah3NclNk4ZyCxlz79w60JXYS95Tg41WkW-ILRVFW-I3lmf3Q48alB6OVFFmFyBESyeRovylc0yKoFR2laEdBeioH972qu_mS3mMTc-sb-OyDxnYONEe1WKYgIoHkt4fbhM-pXBoYAR5p0-2o2PHLkoLR8 Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: c78ff4cbc0994af8855b1ac67cb281fe Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 30 00:05:42.964513 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c78ff4cbc0994af8855b1ac67cb281fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c78ff4cbc0994af8855b1ac67cb281fe", "adminURL": "http://10.222.0.58:8080"}]}] Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: c78ff4cbc0994af8855b1ac67cb281fe Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-TestVolumeBootPattern-1495322451 Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-TestVolumeBootPattern-1495322451-project Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 1e63436f5691431d802706a8d5a6df7f Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-TestVolumeBootPattern-1495322451-project Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:05:42.966350 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '5b660d30-8ce5-48f3-9337-2dbcd3c62e05'} Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:05:42.967389 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. Aug 30 00:05:42.969020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:05:42.970737 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Returning 404 to user: Instance 5b660d30-8ce5-48f3-9337-2dbcd3c62e05 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:05:42.970737 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-533e2334-8185-4b3b-8486-983e5ea57e12 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05" status: 404 len: 111 microversion: 2.1 time: 0.030434 Aug 30 00:05:42.970737 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 574/1163] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:42 2022] GET /compute/v2.1/servers/5b660d30-8ce5-48f3-9337-2dbcd3c62e05 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:05:43.276823 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-186472f7-4d8a-4ce6-bbf3-9b666d84fc68 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:43.277485 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-186472f7-4d8a-4ce6-bbf3-9b666d84fc68 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:43.284588 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-186472f7-4d8a-4ce6-bbf3-9b666d84fc68 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:43.285069 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-186472f7-4d8a-4ce6-bbf3-9b666d84fc68 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:43.285502 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-186472f7-4d8a-4ce6-bbf3-9b666d84fc68 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:43.286193 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-186472f7-4d8a-4ce6-bbf3-9b666d84fc68 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:43.286669 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-186472f7-4d8a-4ce6-bbf3-9b666d84fc68 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:43.287091 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-186472f7-4d8a-4ce6-bbf3-9b666d84fc68 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:43.425936 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-186472f7-4d8a-4ce6-bbf3-9b666d84fc68 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:43.433989 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-186472f7-4d8a-4ce6-bbf3-9b666d84fc68 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.161086 Aug 30 00:05:43.434572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 590/1164] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:43 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:44.459118 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-13c67f1f-4cf7-4de6-b0fd-e9fd8b02264e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:44.459765 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-13c67f1f-4cf7-4de6-b0fd-e9fd8b02264e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:44.466203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13c67f1f-4cf7-4de6-b0fd-e9fd8b02264e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:44.466706 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13c67f1f-4cf7-4de6-b0fd-e9fd8b02264e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:44.467137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13c67f1f-4cf7-4de6-b0fd-e9fd8b02264e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:44.467844 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13c67f1f-4cf7-4de6-b0fd-e9fd8b02264e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:44.468288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13c67f1f-4cf7-4de6-b0fd-e9fd8b02264e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:44.468702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-13c67f1f-4cf7-4de6-b0fd-e9fd8b02264e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:44.531411 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-01675df8-dc3f-430c-8633-cdaca0eb4671 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] Calling method '.version_select at 0x7fabbdca63a0>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:44.622035 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-13c67f1f-4cf7-4de6-b0fd-e9fd8b02264e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:44.628407 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-01675df8-dc3f-430c-8633-cdaca0eb4671 tempest-TestVolumeBootPattern-1495322451 tempest-TestVolumeBootPattern-1495322451-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-406797152" status: 202 len: 0 microversion: 2.1 time: 0.101301 Aug 30 00:05:44.629378 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 591/1165] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Aug 30 00:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-406797152 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:05:44.632288 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-13c67f1f-4cf7-4de6-b0fd-e9fd8b02264e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.176992 Aug 30 00:05:44.632858 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 575/1166] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:44 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:45.654755 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-f5a45b8d-25db-44ab-a418-afaf857128ca tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:45.655375 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-f5a45b8d-25db-44ab-a418-afaf857128ca tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:45.667077 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5a45b8d-25db-44ab-a418-afaf857128ca tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:45.667638 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5a45b8d-25db-44ab-a418-afaf857128ca tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:45.668006 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5a45b8d-25db-44ab-a418-afaf857128ca tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:45.668717 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5a45b8d-25db-44ab-a418-afaf857128ca tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:45.669354 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5a45b8d-25db-44ab-a418-afaf857128ca tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:45.669955 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-f5a45b8d-25db-44ab-a418-afaf857128ca tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:45.822081 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-f5a45b8d-25db-44ab-a418-afaf857128ca tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:45.832042 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-f5a45b8d-25db-44ab-a418-afaf857128ca tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.181522 Aug 30 00:05:45.833067 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 592/1167] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:45 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:46.853161 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f8f36cd6-68f6-46e5-9493-2dc7da5f78bb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:46.853884 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f8f36cd6-68f6-46e5-9493-2dc7da5f78bb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:46.860877 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f8f36cd6-68f6-46e5-9493-2dc7da5f78bb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:46.863680 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f8f36cd6-68f6-46e5-9493-2dc7da5f78bb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:46.863680 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f8f36cd6-68f6-46e5-9493-2dc7da5f78bb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:46.863680 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f8f36cd6-68f6-46e5-9493-2dc7da5f78bb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:46.863680 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f8f36cd6-68f6-46e5-9493-2dc7da5f78bb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:46.864065 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f8f36cd6-68f6-46e5-9493-2dc7da5f78bb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:46.997964 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f8f36cd6-68f6-46e5-9493-2dc7da5f78bb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:47.006312 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f8f36cd6-68f6-46e5-9493-2dc7da5f78bb tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.157071 Aug 30 00:05:47.006910 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 576/1168] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:46 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:48.028501 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-a65c34ea-7a1b-4908-b742-29eb2c757ad0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:48.029065 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-a65c34ea-7a1b-4908-b742-29eb2c757ad0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:48.036052 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a65c34ea-7a1b-4908-b742-29eb2c757ad0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:48.036841 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a65c34ea-7a1b-4908-b742-29eb2c757ad0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:48.037270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a65c34ea-7a1b-4908-b742-29eb2c757ad0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:48.038157 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a65c34ea-7a1b-4908-b742-29eb2c757ad0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:48.038803 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a65c34ea-7a1b-4908-b742-29eb2c757ad0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:48.039053 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-a65c34ea-7a1b-4908-b742-29eb2c757ad0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:48.216572 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-a65c34ea-7a1b-4908-b742-29eb2c757ad0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:48.230623 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-a65c34ea-7a1b-4908-b742-29eb2c757ad0 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.201144 Aug 30 00:05:48.231278 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 593/1169] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:48 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:49.252439 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d72bf9b4-29e8-4412-90a1-d225f9bd31b3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:49.253914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d72bf9b4-29e8-4412-90a1-d225f9bd31b3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:49.260666 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d72bf9b4-29e8-4412-90a1-d225f9bd31b3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:49.261247 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d72bf9b4-29e8-4412-90a1-d225f9bd31b3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:49.261754 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d72bf9b4-29e8-4412-90a1-d225f9bd31b3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:49.262630 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d72bf9b4-29e8-4412-90a1-d225f9bd31b3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:49.263408 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d72bf9b4-29e8-4412-90a1-d225f9bd31b3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:49.264061 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d72bf9b4-29e8-4412-90a1-d225f9bd31b3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:49.409076 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d72bf9b4-29e8-4412-90a1-d225f9bd31b3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:49.417304 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d72bf9b4-29e8-4412-90a1-d225f9bd31b3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.168900 Aug 30 00:05:49.418187 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 577/1170] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:49 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:50.440425 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-feec59a1-4d22-46a7-ab50-726a965bfd26 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:50.441040 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-feec59a1-4d22-46a7-ab50-726a965bfd26 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:50.447808 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-feec59a1-4d22-46a7-ab50-726a965bfd26 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:50.448302 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-feec59a1-4d22-46a7-ab50-726a965bfd26 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:50.448737 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-feec59a1-4d22-46a7-ab50-726a965bfd26 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:50.449669 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-feec59a1-4d22-46a7-ab50-726a965bfd26 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:50.450300 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-feec59a1-4d22-46a7-ab50-726a965bfd26 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:50.450761 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-feec59a1-4d22-46a7-ab50-726a965bfd26 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:50.605705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-feec59a1-4d22-46a7-ab50-726a965bfd26 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:50.614952 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-feec59a1-4d22-46a7-ab50-726a965bfd26 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1570 microversion: 2.1 time: 0.178456 Aug 30 00:05:50.615535 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 594/1171] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:50 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:50.636810 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-001ea69a-e99c-4990-adb2-eac5c5aceb6f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:50.637479 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-001ea69a-e99c-4990-adb2-eac5c5aceb6f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:50.644320 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-001ea69a-e99c-4990-adb2-eac5c5aceb6f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:50.644734 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-001ea69a-e99c-4990-adb2-eac5c5aceb6f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:50.645164 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-001ea69a-e99c-4990-adb2-eac5c5aceb6f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:50.645856 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-001ea69a-e99c-4990-adb2-eac5c5aceb6f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:50.646743 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-001ea69a-e99c-4990-adb2-eac5c5aceb6f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:50.647160 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-001ea69a-e99c-4990-adb2-eac5c5aceb6f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:50.665398 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:50.692481 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-001ea69a-e99c-4990-adb2-eac5c5aceb6f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127706) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 00:05:51.059693 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-001ea69a-e99c-4990-adb2-eac5c5aceb6f tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "POST /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52/action" status: 202 len: 0 microversion: 2.1 time: 0.426824 Aug 30 00:05:51.065303 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 578/1172] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 30 00:05:50 2022] POST /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:05:51.071409 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-2241adb6-9e83-46e1-9fbb-e57c1a0cfd36 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:51.072482 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-2241adb6-9e83-46e1-9fbb-e57c1a0cfd36 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:51.080981 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2241adb6-9e83-46e1-9fbb-e57c1a0cfd36 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:51.081504 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2241adb6-9e83-46e1-9fbb-e57c1a0cfd36 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:51.081939 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2241adb6-9e83-46e1-9fbb-e57c1a0cfd36 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:51.082688 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2241adb6-9e83-46e1-9fbb-e57c1a0cfd36 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:51.084601 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2241adb6-9e83-46e1-9fbb-e57c1a0cfd36 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:51.085226 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-2241adb6-9e83-46e1-9fbb-e57c1a0cfd36 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:51.241591 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-2241adb6-9e83-46e1-9fbb-e57c1a0cfd36 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:51.249874 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-2241adb6-9e83-46e1-9fbb-e57c1a0cfd36 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1518 microversion: 2.1 time: 0.184463 Aug 30 00:05:51.250460 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 595/1173] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:51 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:05:52.272997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-187832c5-5460-4b8b-af58-6e80b34547ce tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:52.273620 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-187832c5-5460-4b8b-af58-6e80b34547ce tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:52.280054 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-187832c5-5460-4b8b-af58-6e80b34547ce tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:52.280540 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-187832c5-5460-4b8b-af58-6e80b34547ce tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:52.280978 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-187832c5-5460-4b8b-af58-6e80b34547ce tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:52.281980 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-187832c5-5460-4b8b-af58-6e80b34547ce tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:52.282459 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-187832c5-5460-4b8b-af58-6e80b34547ce tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:52.282922 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-187832c5-5460-4b8b-af58-6e80b34547ce tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:52.565135 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-187832c5-5460-4b8b-af58-6e80b34547ce tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:52.575398 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-187832c5-5460-4b8b-af58-6e80b34547ce tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1518 microversion: 2.1 time: 0.306972 Aug 30 00:05:52.575992 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 579/1174] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:52 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1518 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:52.782873 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-d68a06f2-6988-45d2-8d79-5f26fb311acd req-91ff1fd7-afeb-4324-9065-0b5bf0daa305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4f99d9-6f44-41d0-ab65-7464370d9d52", "name": "network-vif-unplugged", "status": "completed", "tag": "d8e2f48a-54fa-4f95-996f-1ce84820f6ed"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:05:52.792810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-d68a06f2-6988-45d2-8d79-5f26fb311acd req-91ff1fd7-afeb-4324-9065-0b5bf0daa305 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:52.793284 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-d68a06f2-6988-45d2-8d79-5f26fb311acd req-91ff1fd7-afeb-4324-9065-0b5bf0daa305 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:52.793707 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-d68a06f2-6988-45d2-8d79-5f26fb311acd req-91ff1fd7-afeb-4324-9065-0b5bf0daa305 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:52.797566 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:52.805051 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.compute.server_external_events [req-d68a06f2-6988-45d2-8d79-5f26fb311acd req-91ff1fd7-afeb-4324-9065-0b5bf0daa305 service nova] Unable to find a host for instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52. Dropping event network-vif-unplugged {{(pid=127705) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 00:05:52.805936 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-d68a06f2-6988-45d2-8d79-5f26fb311acd req-91ff1fd7-afeb-4324-9065-0b5bf0daa305 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027381 Aug 30 00:05:52.806724 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 596/1175] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 00:05:53.599959 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-999ece6c-55e2-4f01-8c4e-ce31cb12afd3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:53.600653 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-999ece6c-55e2-4f01-8c4e-ce31cb12afd3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:53.607420 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-999ece6c-55e2-4f01-8c4e-ce31cb12afd3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:53.607910 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-999ece6c-55e2-4f01-8c4e-ce31cb12afd3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:53.608429 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-999ece6c-55e2-4f01-8c4e-ce31cb12afd3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:53.609021 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-999ece6c-55e2-4f01-8c4e-ce31cb12afd3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:53.609501 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-999ece6c-55e2-4f01-8c4e-ce31cb12afd3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:53.609923 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-999ece6c-55e2-4f01-8c4e-ce31cb12afd3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:53.752204 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-999ece6c-55e2-4f01-8c4e-ce31cb12afd3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:53.761028 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-999ece6c-55e2-4f01-8c4e-ce31cb12afd3 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1518 microversion: 2.1 time: 0.167748 Aug 30 00:05:53.761804 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 580/1176] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:53 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:54.783705 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-7d0a389a-8e5b-4c7c-bbd7-aff7ebaee596 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:54.784321 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-7d0a389a-8e5b-4c7c-bbd7-aff7ebaee596 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:54.792649 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7d0a389a-8e5b-4c7c-bbd7-aff7ebaee596 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:54.793224 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7d0a389a-8e5b-4c7c-bbd7-aff7ebaee596 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:54.793769 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7d0a389a-8e5b-4c7c-bbd7-aff7ebaee596 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:54.794570 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7d0a389a-8e5b-4c7c-bbd7-aff7ebaee596 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:54.795027 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7d0a389a-8e5b-4c7c-bbd7-aff7ebaee596 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:54.795475 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-7d0a389a-8e5b-4c7c-bbd7-aff7ebaee596 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:54.953097 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-7d0a389a-8e5b-4c7c-bbd7-aff7ebaee596 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:54.964855 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-7d0a389a-8e5b-4c7c-bbd7-aff7ebaee596 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1518 microversion: 2.1 time: 0.185769 Aug 30 00:05:54.965455 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 597/1177] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:54 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:55.988490 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9cd0022d-5704-49bf-beb4-878b6043a9c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:55.989091 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9cd0022d-5704-49bf-beb4-878b6043a9c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:55.996158 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9cd0022d-5704-49bf-beb4-878b6043a9c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:55.996158 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9cd0022d-5704-49bf-beb4-878b6043a9c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:55.996520 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9cd0022d-5704-49bf-beb4-878b6043a9c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:55.997212 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9cd0022d-5704-49bf-beb4-878b6043a9c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:55.997653 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9cd0022d-5704-49bf-beb4-878b6043a9c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:55.998065 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9cd0022d-5704-49bf-beb4-878b6043a9c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:56.151465 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9cd0022d-5704-49bf-beb4-878b6043a9c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:56.160616 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9cd0022d-5704-49bf-beb4-878b6043a9c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1518 microversion: 2.1 time: 0.177075 Aug 30 00:05:56.161197 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 581/1178] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:55 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:57.182086 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-72a9dc1e-dae6-43dd-8f38-1a0402f1d51e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:57.182654 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-72a9dc1e-dae6-43dd-8f38-1a0402f1d51e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:57.190161 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-72a9dc1e-dae6-43dd-8f38-1a0402f1d51e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:57.190652 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-72a9dc1e-dae6-43dd-8f38-1a0402f1d51e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:57.191155 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-72a9dc1e-dae6-43dd-8f38-1a0402f1d51e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:57.191921 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-72a9dc1e-dae6-43dd-8f38-1a0402f1d51e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:57.192403 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-72a9dc1e-dae6-43dd-8f38-1a0402f1d51e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:57.192822 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-72a9dc1e-dae6-43dd-8f38-1a0402f1d51e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:57.332882 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-72a9dc1e-dae6-43dd-8f38-1a0402f1d51e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:57.340984 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-72a9dc1e-dae6-43dd-8f38-1a0402f1d51e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1520 microversion: 2.1 time: 0.163100 Aug 30 00:05:57.341551 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 598/1179] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:57 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:58.369588 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-f20e2a6c-6644-4c65-929f-d558a7eb1f44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:58.370195 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-f20e2a6c-6644-4c65-929f-d558a7eb1f44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:58.376828 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f20e2a6c-6644-4c65-929f-d558a7eb1f44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:58.377319 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f20e2a6c-6644-4c65-929f-d558a7eb1f44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:58.377823 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f20e2a6c-6644-4c65-929f-d558a7eb1f44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:58.378555 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f20e2a6c-6644-4c65-929f-d558a7eb1f44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:58.379013 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f20e2a6c-6644-4c65-929f-d558a7eb1f44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:58.379442 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-f20e2a6c-6644-4c65-929f-d558a7eb1f44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:58.519186 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-f20e2a6c-6644-4c65-929f-d558a7eb1f44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:58.527090 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-f20e2a6c-6644-4c65-929f-d558a7eb1f44 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.161432 Aug 30 00:05:58.527660 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 582/1180] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:58 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:05:59.550104 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b7f84893-6486-4649-86b8-0f4fe0881087 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:05:59.550677 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b7f84893-6486-4649-86b8-0f4fe0881087 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:05:59.557124 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7f84893-6486-4649-86b8-0f4fe0881087 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:59.557606 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7f84893-6486-4649-86b8-0f4fe0881087 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:59.558039 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7f84893-6486-4649-86b8-0f4fe0881087 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:59.558781 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7f84893-6486-4649-86b8-0f4fe0881087 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:05:59.559230 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7f84893-6486-4649-86b8-0f4fe0881087 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:05:59.559653 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b7f84893-6486-4649-86b8-0f4fe0881087 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:05:59.700147 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b7f84893-6486-4649-86b8-0f4fe0881087 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:05:59.708559 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b7f84893-6486-4649-86b8-0f4fe0881087 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.162720 Aug 30 00:05:59.709122 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 599/1181] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:05:59 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:00.730063 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5ecb1116-99aa-41d8-b961-df4677fdb92a tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:00.730648 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5ecb1116-99aa-41d8-b961-df4677fdb92a tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:00.732741 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=3 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:00.738105 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ecb1116-99aa-41d8-b961-df4677fdb92a tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:00.738855 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ecb1116-99aa-41d8-b961-df4677fdb92a tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:00.739277 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ecb1116-99aa-41d8-b961-df4677fdb92a tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:00.739997 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ecb1116-99aa-41d8-b961-df4677fdb92a tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:00.740433 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ecb1116-99aa-41d8-b961-df4677fdb92a tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:00.740845 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5ecb1116-99aa-41d8-b961-df4677fdb92a tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:00.874381 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5ecb1116-99aa-41d8-b961-df4677fdb92a tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:00.883018 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5ecb1116-99aa-41d8-b961-df4677fdb92a tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.156730 Aug 30 00:06:00.883876 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 583/1182] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:00 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:01.904127 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8678c980-b56b-4093-aeab-db4fdc06992e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:01.904736 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8678c980-b56b-4093-aeab-db4fdc06992e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:01.907744 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:01.912428 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8678c980-b56b-4093-aeab-db4fdc06992e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:01.912905 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8678c980-b56b-4093-aeab-db4fdc06992e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:01.913521 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8678c980-b56b-4093-aeab-db4fdc06992e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:01.922281 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8678c980-b56b-4093-aeab-db4fdc06992e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:01.923471 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8678c980-b56b-4093-aeab-db4fdc06992e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:01.923917 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8678c980-b56b-4093-aeab-db4fdc06992e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:02.061270 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-8678c980-b56b-4093-aeab-db4fdc06992e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:02.069954 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8678c980-b56b-4093-aeab-db4fdc06992e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.169737 Aug 30 00:06:02.070537 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 600/1183] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:01 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:03.091424 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d536487f-a299-44da-961f-d4f0d981deb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:03.092061 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d536487f-a299-44da-961f-d4f0d981deb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:03.099479 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d536487f-a299-44da-961f-d4f0d981deb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:03.099953 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d536487f-a299-44da-961f-d4f0d981deb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:03.100378 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d536487f-a299-44da-961f-d4f0d981deb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:03.101053 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d536487f-a299-44da-961f-d4f0d981deb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:03.101495 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d536487f-a299-44da-961f-d4f0d981deb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:03.101909 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d536487f-a299-44da-961f-d4f0d981deb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:03.236167 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-d536487f-a299-44da-961f-d4f0d981deb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:03.244238 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d536487f-a299-44da-961f-d4f0d981deb8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.156663 Aug 30 00:06:03.244800 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 584/1184] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:03 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:04.266311 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-b1c23c75-c1f9-46e2-a9ec-8fbf8958f4fe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:04.267516 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-b1c23c75-c1f9-46e2-a9ec-8fbf8958f4fe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:04.273904 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c23c75-c1f9-46e2-a9ec-8fbf8958f4fe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:04.274478 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c23c75-c1f9-46e2-a9ec-8fbf8958f4fe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:04.274926 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c23c75-c1f9-46e2-a9ec-8fbf8958f4fe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:04.275618 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c23c75-c1f9-46e2-a9ec-8fbf8958f4fe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:04.276060 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c23c75-c1f9-46e2-a9ec-8fbf8958f4fe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:04.276477 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-b1c23c75-c1f9-46e2-a9ec-8fbf8958f4fe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:04.409392 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-b1c23c75-c1f9-46e2-a9ec-8fbf8958f4fe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:04.417330 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-b1c23c75-c1f9-46e2-a9ec-8fbf8958f4fe tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.154988 Aug 30 00:06:04.417888 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 601/1185] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:04 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:05.438137 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-76404780-b9c7-486a-8cf7-e8ee219a4181 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:05.439593 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-76404780-b9c7-486a-8cf7-e8ee219a4181 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:05.445987 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-76404780-b9c7-486a-8cf7-e8ee219a4181 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:05.446485 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-76404780-b9c7-486a-8cf7-e8ee219a4181 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:05.446913 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-76404780-b9c7-486a-8cf7-e8ee219a4181 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:05.447589 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-76404780-b9c7-486a-8cf7-e8ee219a4181 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:05.448030 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-76404780-b9c7-486a-8cf7-e8ee219a4181 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:05.448445 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-76404780-b9c7-486a-8cf7-e8ee219a4181 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:05.583477 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-76404780-b9c7-486a-8cf7-e8ee219a4181 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:05.591171 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-76404780-b9c7-486a-8cf7-e8ee219a4181 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.156849 Aug 30 00:06:05.591729 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 585/1186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:05 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:06.612018 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-4b2d4d6e-03fe-4687-b7f3-84dc9e3bcf71 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:06.612600 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-4b2d4d6e-03fe-4687-b7f3-84dc9e3bcf71 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:06.619357 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b2d4d6e-03fe-4687-b7f3-84dc9e3bcf71 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:06.619826 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b2d4d6e-03fe-4687-b7f3-84dc9e3bcf71 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:06.620252 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b2d4d6e-03fe-4687-b7f3-84dc9e3bcf71 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:06.620937 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b2d4d6e-03fe-4687-b7f3-84dc9e3bcf71 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:06.621411 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b2d4d6e-03fe-4687-b7f3-84dc9e3bcf71 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:06.621830 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-4b2d4d6e-03fe-4687-b7f3-84dc9e3bcf71 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:06.965778 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-4b2d4d6e-03fe-4687-b7f3-84dc9e3bcf71 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:06.973964 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-4b2d4d6e-03fe-4687-b7f3-84dc9e3bcf71 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.365825 Aug 30 00:06:06.974684 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 602/1187] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:06 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:07.995182 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-27ab1270-80aa-4c82-8065-277f54f9f9e5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:07.995739 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-27ab1270-80aa-4c82-8065-277f54f9f9e5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:08.002914 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ab1270-80aa-4c82-8065-277f54f9f9e5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:08.003384 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ab1270-80aa-4c82-8065-277f54f9f9e5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:08.003810 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ab1270-80aa-4c82-8065-277f54f9f9e5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:08.004488 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ab1270-80aa-4c82-8065-277f54f9f9e5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:08.004930 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ab1270-80aa-4c82-8065-277f54f9f9e5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:08.005347 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-27ab1270-80aa-4c82-8065-277f54f9f9e5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:08.212057 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-27ab1270-80aa-4c82-8065-277f54f9f9e5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:08.220004 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-27ab1270-80aa-4c82-8065-277f54f9f9e5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.228481 Aug 30 00:06:08.220564 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 586/1188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:07 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:08.893841 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-e7e25841-587b-44dc-9f50-543f07bcb3a3 req-52281ecc-3c70-4b8a-812b-b4663352dde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4f99d9-6f44-41d0-ab65-7464370d9d52", "name": "network-vif-plugged", "status": "completed", "tag": "d8e2f48a-54fa-4f95-996f-1ce84820f6ed"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:06:08.903800 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-e7e25841-587b-44dc-9f50-543f07bcb3a3 req-52281ecc-3c70-4b8a-812b-b4663352dde8 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:08.904272 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-e7e25841-587b-44dc-9f50-543f07bcb3a3 req-52281ecc-3c70-4b8a-812b-b4663352dde8 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:08.904690 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-e7e25841-587b-44dc-9f50-543f07bcb3a3 req-52281ecc-3c70-4b8a-812b-b4663352dde8 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:08.916034 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-e7e25841-587b-44dc-9f50-543f07bcb3a3 req-52281ecc-3c70-4b8a-812b-b4663352dde8 service nova] Creating event network-vif-plugged:d8e2f48a-54fa-4f95-996f-1ce84820f6ed for instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 on hv-cinder-85427 Aug 30 00:06:08.921204 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-e7e25841-587b-44dc-9f50-543f07bcb3a3 req-52281ecc-3c70-4b8a-812b-b4663352dde8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Aug 30 00:06:08.921810 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 603/1189] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:06:09.242000 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-5a616733-df81-4fd0-8e4f-eeb1d50a3b7e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:09.242643 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-5a616733-df81-4fd0-8e4f-eeb1d50a3b7e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:09.249725 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5a616733-df81-4fd0-8e4f-eeb1d50a3b7e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:09.250205 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5a616733-df81-4fd0-8e4f-eeb1d50a3b7e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:09.250677 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5a616733-df81-4fd0-8e4f-eeb1d50a3b7e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:09.251458 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5a616733-df81-4fd0-8e4f-eeb1d50a3b7e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:09.251985 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5a616733-df81-4fd0-8e4f-eeb1d50a3b7e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:09.252402 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-5a616733-df81-4fd0-8e4f-eeb1d50a3b7e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:09.388906 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-5a616733-df81-4fd0-8e4f-eeb1d50a3b7e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:09.396967 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-5a616733-df81-4fd0-8e4f-eeb1d50a3b7e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.159095 Aug 30 00:06:09.397542 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 587/1190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:09 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:06:10.420581 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-367358d1-eef0-44f4-9db7-f577d06d71e8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:10.421306 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-367358d1-eef0-44f4-9db7-f577d06d71e8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:10.427703 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-367358d1-eef0-44f4-9db7-f577d06d71e8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:10.428185 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-367358d1-eef0-44f4-9db7-f577d06d71e8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:10.428616 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-367358d1-eef0-44f4-9db7-f577d06d71e8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:10.429307 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-367358d1-eef0-44f4-9db7-f577d06d71e8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:10.429758 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-367358d1-eef0-44f4-9db7-f577d06d71e8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:10.430177 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-367358d1-eef0-44f4-9db7-f577d06d71e8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:10.564815 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-367358d1-eef0-44f4-9db7-f577d06d71e8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:10.572959 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-367358d1-eef0-44f4-9db7-f577d06d71e8 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1576 microversion: 2.1 time: 0.157448 Aug 30 00:06:10.573523 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 604/1191] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:10 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:06:11.594117 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-4f1bb596-70c1-4c9a-aa8a-a7cccec85519 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:06:11.594741 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-4f1bb596-70c1-4c9a-aa8a-a7cccec85519 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:06:11.602139 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4f1bb596-70c1-4c9a-aa8a-a7cccec85519 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:11.602593 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4f1bb596-70c1-4c9a-aa8a-a7cccec85519 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:11.603020 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4f1bb596-70c1-4c9a-aa8a-a7cccec85519 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:11.603702 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4f1bb596-70c1-4c9a-aa8a-a7cccec85519 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:06:11.604146 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4f1bb596-70c1-4c9a-aa8a-a7cccec85519 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:06:11.604563 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-4f1bb596-70c1-4c9a-aa8a-a7cccec85519 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:06:11.739664 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-4f1bb596-70c1-4c9a-aa8a-a7cccec85519 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:06:11.747457 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-4f1bb596-70c1-4c9a-aa8a-a7cccec85519 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1563 microversion: 2.1 time: 0.157204 Aug 30 00:06:11.748032 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 588/1192] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:06:11 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:31.229064 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_api:SELECT=9 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:31.230466 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG dbcounter [-] [127705] Writing DB stats nova_cell1:SELECT=44 {{(pid=127705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:31.234822 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_api:SELECT=11 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:31.234822 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG dbcounter [-] [127706] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:31.235436 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-8cfc6819-00f5-4751-9dd7-f5839457b84e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:31.236119 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8cfc6819-00f5-4751-9dd7-f5839457b84e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:31.239761 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [req-1d3ef391-99f1-41ed-836b-7731f11ab14e req-1c6320bf-b97b-4512-bc4a-3c91385bda4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4f99d9-6f44-41d0-ab65-7464370d9d52", "tag": "d8e2f48a-54fa-4f95-996f-1ce84820f6ed"}]} {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:07:31.243805 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8cfc6819-00f5-4751-9dd7-f5839457b84e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:31.244535 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8cfc6819-00f5-4751-9dd7-f5839457b84e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:31.244970 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8cfc6819-00f5-4751-9dd7-f5839457b84e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:31.245657 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8cfc6819-00f5-4751-9dd7-f5839457b84e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:31.246277 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8cfc6819-00f5-4751-9dd7-f5839457b84e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:31.246902 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-8cfc6819-00f5-4751-9dd7-f5839457b84e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:31.252793 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-1d3ef391-99f1-41ed-836b-7731f11ab14e req-1c6320bf-b97b-4512-bc4a-3c91385bda4e service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:31.257776 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-1d3ef391-99f1-41ed-836b-7731f11ab14e req-1c6320bf-b97b-4512-bc4a-3c91385bda4e service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:31.257776 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [req-1d3ef391-99f1-41ed-836b-7731f11ab14e req-1c6320bf-b97b-4512-bc4a-3c91385bda4e service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:31.271156 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.compute.server_external_events [req-1d3ef391-99f1-41ed-836b-7731f11ab14e req-1c6320bf-b97b-4512-bc4a-3c91385bda4e service nova] Creating event network-changed:d8e2f48a-54fa-4f95-996f-1ce84820f6ed for instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 on hv-cinder-85427 Aug 30 00:07:31.274609 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-8cfc6819-00f5-4751-9dd7-f5839457b84e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Going to try to terminate instance {{(pid=127705) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:07:31.276928 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [req-1d3ef391-99f1-41ed-836b-7731f11ab14e req-1c6320bf-b97b-4512-bc4a-3c91385bda4e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047635 Aug 30 00:07:31.279573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 589/1193] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:07:31.648592 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-8cfc6819-00f5-4751-9dd7-f5839457b84e tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 204 len: 0 microversion: 2.1 time: 0.421568 Aug 30 00:07:31.649528 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 605/1194] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 30 00:07:31 2022] DELETE /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:07:31.658796 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-b2de19e8-0d25-4641-9287-6c87ab7be8f7 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:31.659488 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-b2de19e8-0d25-4641-9287-6c87ab7be8f7 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:31.667606 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b2de19e8-0d25-4641-9287-6c87ab7be8f7 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:31.668088 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b2de19e8-0d25-4641-9287-6c87ab7be8f7 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:31.668512 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b2de19e8-0d25-4641-9287-6c87ab7be8f7 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:31.669372 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b2de19e8-0d25-4641-9287-6c87ab7be8f7 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:31.670054 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b2de19e8-0d25-4641-9287-6c87ab7be8f7 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:31.670054 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-b2de19e8-0d25-4641-9287-6c87ab7be8f7 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:31.810640 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-b2de19e8-0d25-4641-9287-6c87ab7be8f7 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:31.819051 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-b2de19e8-0d25-4641-9287-6c87ab7be8f7 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.165044 Aug 30 00:07:31.819729 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 590/1195] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:31 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:32.841885 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-652afc0a-d1e2-4a61-b953-fa795db081c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:32.842639 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-652afc0a-d1e2-4a61-b953-fa795db081c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:32.850179 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-652afc0a-d1e2-4a61-b953-fa795db081c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:32.850701 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-652afc0a-d1e2-4a61-b953-fa795db081c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:32.851138 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-652afc0a-d1e2-4a61-b953-fa795db081c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:32.851823 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-652afc0a-d1e2-4a61-b953-fa795db081c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:32.852264 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-652afc0a-d1e2-4a61-b953-fa795db081c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:32.852677 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-652afc0a-d1e2-4a61-b953-fa795db081c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:32.991329 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-652afc0a-d1e2-4a61-b953-fa795db081c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:32.999471 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-652afc0a-d1e2-4a61-b953-fa795db081c2 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1569 microversion: 2.1 time: 0.161865 Aug 30 00:07:33.000037 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 606/1196] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:32 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:34.027573 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-9184da2c-2270-4af1-a99f-5ce21a5f54ae tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:34.028203 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-9184da2c-2270-4af1-a99f-5ce21a5f54ae tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:34.036199 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9184da2c-2270-4af1-a99f-5ce21a5f54ae tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:34.036705 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9184da2c-2270-4af1-a99f-5ce21a5f54ae tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:34.037165 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9184da2c-2270-4af1-a99f-5ce21a5f54ae tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:34.037879 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9184da2c-2270-4af1-a99f-5ce21a5f54ae tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:34.038327 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9184da2c-2270-4af1-a99f-5ce21a5f54ae tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:34.038778 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-9184da2c-2270-4af1-a99f-5ce21a5f54ae tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:34.089136 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [req-17af8f3f-fbf1-48b2-9bba-a51a13c7dbb3 req-8cb8eee5-862d-45d1-8619-a137d164f506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4f99d9-6f44-41d0-ab65-7464370d9d52", "name": "network-vif-deleted", "tag": "d8e2f48a-54fa-4f95-996f-1ce84820f6ed"}]} {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:07:34.100012 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-17af8f3f-fbf1-48b2-9bba-a51a13c7dbb3 req-8cb8eee5-862d-45d1-8619-a137d164f506 service nova] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:34.100531 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-17af8f3f-fbf1-48b2-9bba-a51a13c7dbb3 req-8cb8eee5-862d-45d1-8619-a137d164f506 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:34.100963 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [req-17af8f3f-fbf1-48b2-9bba-a51a13c7dbb3 req-8cb8eee5-862d-45d1-8619-a137d164f506 service nova] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:34.109112 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.policy [None req-9184da2c-2270-4af1-a99f-5ce21a5f54ae tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127706) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:34.112548 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.compute.server_external_events [req-17af8f3f-fbf1-48b2-9bba-a51a13c7dbb3 req-8cb8eee5-862d-45d1-8619-a137d164f506 service nova] Creating event network-vif-deleted:d8e2f48a-54fa-4f95-996f-1ce84820f6ed for instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 on hv-cinder-85427 Aug 30 00:07:34.118447 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [req-17af8f3f-fbf1-48b2-9bba-a51a13c7dbb3 req-8cb8eee5-862d-45d1-8619-a137d164f506 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032841 Aug 30 00:07:34.118662 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-9184da2c-2270-4af1-a99f-5ce21a5f54ae tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1382 microversion: 2.1 time: 0.101836 Aug 30 00:07:34.119048 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 591/1198] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:34 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1382 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:34.119308 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 607/1198] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 30 00:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:07:35.140841 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:35.141611 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.compute.api [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127705) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:35.148142 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:35.151484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:35.151484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:35.151484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:35.151484 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:35.152262 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:35.185924 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:35.186408 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:35.186866 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG oslo_concurrency.lockutils [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:35.187314 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.objects.instance [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lazy-loading 'fault' on Instance uuid 1b4f99d9-6f44-41d0-ab65-7464370d9d52 {{(pid=127705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:07:35.230838 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.policy [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6825bc701a46434d8bc9dd62c203ec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516b21ff0b6423cbed032257af13839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127705) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:07:35.239189 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-77bec2fb-cc39-4314-a42f-1bf0aefcc72d tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 200 len: 1224 microversion: 2.1 time: 0.103160 Aug 30 00:07:35.239757 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 608/1199] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:35 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:07:36.261121 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '>' {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:36.261733 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.compute.api [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] [instance: 1b4f99d9-6f44-41d0-ab65-7464370d9d52] Fetching instance by UUID {{(pid=127706) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:07:36.268063 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:36.268533 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:36.268961 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:36.270710 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Acquiring lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:07:36.271367 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:07:36.272038 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG oslo_concurrency.lockutils [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Lock "2479a3ab-d4a9-4ea8-94e1-1b0f52aef533" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:07:36.285759 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.wsgi [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] HTTP exception thrown: Instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 could not be found. Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Request method failure captured: Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: request: GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 HTTP/1.1 Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept: application/json Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Accept-Encoding: identity Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Connection: close Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Length: 0 Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Content-Type: application/json Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Host: 10.222.0.58 Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: Openstack-System-Scope: None Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: User-Agent: python-urllib3/1.26.12 Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Auth-Token: gAAAAABjDVOmorZOyaebn4XsuFh6bGH4BFxoUYYIUeDMcw-iv_XnKUm02UJhRQk4rhRVVWwbnPN9lviJfKkqZf-xhK0C6r5FysJlBDSYmh2aDPZacAmDkk25fFqzIUsKP7pEiGYklcaTv_cQj5O-zhsyPN2jhq7rSXiXP0-B5JiLW_Cv-sj2_0g Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Id: None Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Domain-Name: None Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Identity-Status: Confirmed Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Is-Admin-Project: True Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Id: default Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Domain-Name: Default Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Id: 6516b21ff0b6423cbed032257af13839 Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Project-Name: tempest-TestShelveInstance-1285910196 Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Role: member,reader Aug 30 00:07:36.287425 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Roles: member,reader Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6516b21ff0b6423cbed032257af13839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6516b21ff0b6423cbed032257af13839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6516b21ff0b6423cbed032257af13839"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6516b21ff0b6423cbed032257af13839", "adminURL": "http://10.222.0.58:8080"}]}] Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant: tempest-TestShelveInstance-1285910196 Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Id: 6516b21ff0b6423cbed032257af13839 Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-Tenant-Name: tempest-TestShelveInstance-1285910196 Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User: tempest-TestShelveInstance-1285910196-project Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Id: default Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Domain-Name: Default Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Id: 6825bc701a46434d8bc9dd62c203ec83 Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: X-User-Name: tempest-TestShelveInstance-1285910196-project Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: method: > Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: exception: Instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 could not be found. Aug 30 00:07:36.289346 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: action_args: {'id': '1b4f99d9-6f44-41d0-ab65-7464370d9d52'} Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: {{(pid=127706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 could not be found. Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:07:36.290484 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 could not be found. Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 could not be found. Aug 30 00:07:36.292191 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: ERROR nova.api.openstack.wsgi Aug 30 00:07:36.293961 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: DEBUG nova.api.openstack.wsgi [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Returning 404 to user: Instance 1b4f99d9-6f44-41d0-ab65-7464370d9d52 could not be found. {{(pid=127706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:07:36.293961 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: INFO nova.api.openstack.requestlog [None req-d682cf21-8f06-4e18-ade4-a79a2d3decf5 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52" status: 404 len: 111 microversion: 2.1 time: 0.031655 Aug 30 00:07:36.293961 dv-cinder-854272-4-iscsi devstack@n-api.service[127706]: [pid: 127706|app: 0|req: 592/1200] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 30 00:07:36 2022] GET /compute/v2.1/servers/1b4f99d9-6f44-41d0-ab65-7464370d9d52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:07:36.556624 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: DEBUG nova.api.openstack.wsgi [None req-9ecc75c3-b3c6-4ad5-87c5-709973910e84 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] Calling method '.version_select at 0x7fabbdeccb80>' {{(pid=127705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:07:36.638825 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: INFO nova.api.openstack.requestlog [None req-9ecc75c3-b3c6-4ad5-87c5-709973910e84 tempest-TestShelveInstance-1285910196 tempest-TestShelveInstance-1285910196-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1388111469" status: 202 len: 0 microversion: 2.1 time: 0.085651 Aug 30 00:07:36.639186 dv-cinder-854272-4-iscsi devstack@n-api.service[127705]: [pid: 127705|app: 0|req: 609/1201] 10.222.0.58 () {58 vars in 1254 bytes} [Tue Aug 30 00:07:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1388111469 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)